docs: format Method pipeline as tree
Browse files
README.md
CHANGED
|
@@ -86,6 +86,15 @@ The model is a dual-channel linear classifier: TF-IDF `char_wb` (2β5) and word
|
|
| 86 |
trained with hard negatives from sister Turkic languages, Russian and
|
| 87 |
technical/noisy text. Training texts are not distributed in this repository.
|
| 88 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 89 |
### Evaluation
|
| 90 |
|
| 91 |
On a weak-label 4,000-sentence benchmark the model reached **93.25% binary
|
|
@@ -168,7 +177,7 @@ works without extra arguments.
|
|
| 168 |
## License
|
| 169 |
|
| 170 |
The code and model export are released under the
|
| 171 |
-
[Apache-2.0 license](https://huggingface.co/failed09/bashkir-lid/blob/main/LICENSE). Training texts
|
| 172 |
are not included in this repository.
|
| 173 |
|
| 174 |
## Citation
|
|
|
|
| 86 |
trained with hard negatives from sister Turkic languages, Russian and
|
| 87 |
technical/noisy text. Training texts are not distributed in this repository.
|
| 88 |
|
| 89 |
+
```text
|
| 90 |
+
training data (Bashkir + hard negative Turkic/Russian/noise)
|
| 91 |
+
βββ 1. extract character n-grams: char_wb (2β5)
|
| 92 |
+
βββ 2. extract word n-grams: words (1β2)
|
| 93 |
+
βββ 3. feature union & TF-IDF vectorization
|
| 94 |
+
βββ 4. train SGDClassifier with log-loss
|
| 95 |
+
βββ 5. export calibrated ONNX graph (fast single-pass classification)
|
| 96 |
+
```
|
| 97 |
+
|
| 98 |
### Evaluation
|
| 99 |
|
| 100 |
On a weak-label 4,000-sentence benchmark the model reached **93.25% binary
|
|
|
|
| 177 |
## License
|
| 178 |
|
| 179 |
The code and model export are released under the
|
| 180 |
+
[Apache-2.0 license](https://huggingface.co/failed09/bashkir-lid/blob/main/LICENSE). Training texts
|
| 181 |
are not included in this repository.
|
| 182 |
|
| 183 |
## Citation
|