Instructions to use vpermilp/spellman with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- fastText
How to use vpermilp/spellman with fastText:
from huggingface_hub import hf_hub_download import fasttext model = fasttext.load_model(hf_hub_download("vpermilp/spellman", "model.bin")) - Notebooks
- Google Colab
- Kaggle
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -104,22 +104,22 @@ printf 'Қазақша\nHello\n' | spellman detect --lines # kaz /
|
|
| 104 |
|
| 105 |
| eval | accuracy |
|
| 106 |
|---|---|
|
| 107 |
-
| held-out mix (
|
| 108 |
-
| Tatoeba (37,051, out-of-domain) | 98.
|
| 109 |
| Tatoeba granularity ladder (word / pair / triple) | 66.7 / 86.2 / 93.3 |
|
| 110 |
-
| wild Russian tweets (2,606, label-audited; 61% @mentions, 20% URLs) |
|
| 111 |
-
| COSMUS gold-labeled wild Russian (2,808, unseen) | 96.
|
| 112 |
-
| short-utterance referee (orthography-certified, ≤19 chars) |
|
| 113 |
| throughput | ~3.6 µs/sample (fp16 JIT plan, CPU) |
|
| 114 |
|
| 115 |
On identical eval rows it beats fastText lid.176 (Tatoeba 94.90% vs
|
| 116 |
-
98.
|
| 117 |
its speed; whichlang and lingua cover only 10 and 17 of these 30
|
| 118 |
classes. Against open-LID SOTA GlotLID v3 it wins the wild held-out
|
| 119 |
-
workload (98.
|
| 120 |
-
wild-Russian referee (
|
| 121 |
-
(
|
| 122 |
-
set still leads clean out-of-domain sentences (99.25 vs 98.
|
| 123 |
|
| 124 |
## Training data
|
| 125 |
|
|
|
|
| 104 |
|
| 105 |
| eval | accuracy |
|
| 106 |
|---|---|
|
| 107 |
+
| held-out mix (238,985 rows, pristine test) | 98.31% |
|
| 108 |
+
| Tatoeba (37,051, out-of-domain) | 98.39% |
|
| 109 |
| Tatoeba granularity ladder (word / pair / triple) | 66.7 / 86.2 / 93.3 |
|
| 110 |
+
| wild Russian tweets (2,606, label-audited; 61% @mentions, 20% URLs) | 93.40% |
|
| 111 |
+
| COSMUS gold-labeled wild Russian (2,808, unseen) | 96.72% |
|
| 112 |
+
| short-utterance referee (orthography-certified, ≤19 chars) | 90.07% |
|
| 113 |
| throughput | ~3.6 µs/sample (fp16 JIT plan, CPU) |
|
| 114 |
|
| 115 |
On identical eval rows it beats fastText lid.176 (Tatoeba 94.90% vs
|
| 116 |
+
98.39%) and lingua 1.8 high-accuracy on the shared languages at ~30x
|
| 117 |
its speed; whichlang and lingua cover only 10 and 17 of these 30
|
| 118 |
classes. Against open-LID SOTA GlotLID v3 it wins the wild held-out
|
| 119 |
+
workload (98.31 vs 93.58), the single-word rung (66.6 vs 43.9), the
|
| 120 |
+
wild-Russian referee (93.40 vs 82.73) and the short-utterance referee
|
| 121 |
+
(90.07 vs 71.25) while running ~100x faster; GlotLID's larger training
|
| 122 |
+
set still leads clean out-of-domain sentences (99.25 vs 98.39).
|
| 123 |
|
| 124 |
## Training data
|
| 125 |
|