vpermilp commited on
Commit
ae27fb6
·
verified ·
1 Parent(s): 9fcc57a

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +10 -10
README.md CHANGED
@@ -104,22 +104,22 @@ printf 'Қазақша\nHello\n' | spellman detect --lines # kaz /
104
 
105
  | eval | accuracy |
106
  |---|---|
107
- | held-out mix (239,042 rows, pristine test) | 98.30% |
108
- | Tatoeba (37,051, out-of-domain) | 98.42% |
109
  | Tatoeba granularity ladder (word / pair / triple) | 66.7 / 86.2 / 93.3 |
110
- | wild Russian tweets (2,606, label-audited; 61% @mentions, 20% URLs) | 92.56% |
111
- | COSMUS gold-labeled wild Russian (2,808, unseen) | 96.79% |
112
- | short-utterance referee (orthography-certified, ≤19 chars) | 89.90% |
113
  | throughput | ~3.6 µs/sample (fp16 JIT plan, CPU) |
114
 
115
  On identical eval rows it beats fastText lid.176 (Tatoeba 94.90% vs
116
- 98.42%) and lingua 1.8 high-accuracy on the shared languages at ~30x
117
  its speed; whichlang and lingua cover only 10 and 17 of these 30
118
  classes. Against open-LID SOTA GlotLID v3 it wins the wild held-out
119
- workload (98.30 vs 93.58), the single-word rung (66.7 vs 43.9), the
120
- wild-Russian referee (92.56 vs 82.73) and the short-utterance referee
121
- (89.90 vs 71.25) while running ~100x faster; GlotLID's larger training
122
- set still leads clean out-of-domain sentences (99.25 vs 98.42).
123
 
124
  ## Training data
125
 
 
104
 
105
  | eval | accuracy |
106
  |---|---|
107
+ | held-out mix (238,985 rows, pristine test) | 98.31% |
108
+ | Tatoeba (37,051, out-of-domain) | 98.39% |
109
  | Tatoeba granularity ladder (word / pair / triple) | 66.7 / 86.2 / 93.3 |
110
+ | wild Russian tweets (2,606, label-audited; 61% @mentions, 20% URLs) | 93.40% |
111
+ | COSMUS gold-labeled wild Russian (2,808, unseen) | 96.72% |
112
+ | short-utterance referee (orthography-certified, ≤19 chars) | 90.07% |
113
  | throughput | ~3.6 µs/sample (fp16 JIT plan, CPU) |
114
 
115
  On identical eval rows it beats fastText lid.176 (Tatoeba 94.90% vs
116
+ 98.39%) and lingua 1.8 high-accuracy on the shared languages at ~30x
117
  its speed; whichlang and lingua cover only 10 and 17 of these 30
118
  classes. Against open-LID SOTA GlotLID v3 it wins the wild held-out
119
+ workload (98.31 vs 93.58), the single-word rung (66.6 vs 43.9), the
120
+ wild-Russian referee (93.40 vs 82.73) and the short-utterance referee
121
+ (90.07 vs 71.25) while running ~100x faster; GlotLID's larger training
122
+ set still leads clean out-of-domain sentences (99.25 vs 98.39).
123
 
124
  ## Training data
125