Instructions to use failed09/bashkir-fasttext with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- fastText
How to use failed09/bashkir-fasttext with fastText:
from huggingface_hub import hf_hub_download import fasttext model = fasttext.load_model(hf_hub_download("failed09/bashkir-fasttext", "model.bin")) - Notebooks
- Google Colab
- Kaggle
docs: format Method pipeline as tree
Browse files
README.md
CHANGED
|
@@ -72,8 +72,11 @@ form was never seen during training.
|
|
| 72 |
## Method
|
| 73 |
|
| 74 |
```text
|
| 75 |
-
monolingual Bashkir text
|
| 76 |
-
|
|
|
|
|
|
|
|
|
|
| 77 |
```
|
| 78 |
|
| 79 |
The model was trained from a monolingual Bashkir-language dataset.
|
|
@@ -135,7 +138,7 @@ print(model.similarity("Π°ΡΠ°ΠΉ", "ΣΡΣΠΉ"))
|
|
| 135 |
## License
|
| 136 |
|
| 137 |
The model and release code are provided under the
|
| 138 |
-
[Apache-2.0 license](https://huggingface.co/failed09/bashkir-fasttext/blob/main/LICENSE). The model
|
| 139 |
is derived from upstream and project corpora; this release does not claim
|
| 140 |
ownership of source texts or other training materials. Upstream rights and
|
| 141 |
licensing conditions remain applicable.
|
|
|
|
| 72 |
## Method
|
| 73 |
|
| 74 |
```text
|
| 75 |
+
monolingual Bashkir text (clean corpus)
|
| 76 |
+
βββ 1. Unicode NFC tokenization preserving 9 Bashkir letters
|
| 77 |
+
βββ 2. train skip-gram 300d with subword character n-grams (3β6)
|
| 78 |
+
βββ 3. prune vocabulary to top-50k words and top-100k subwords
|
| 79 |
+
βββ 4. product quantization (PQ FP16) export to mini .bin
|
| 80 |
```
|
| 81 |
|
| 82 |
The model was trained from a monolingual Bashkir-language dataset.
|
|
|
|
| 138 |
## License
|
| 139 |
|
| 140 |
The model and release code are provided under the
|
| 141 |
+
[Apache-2.0 license](https://huggingface.co/failed09/bashkir-fasttext/blob/main/LICENSE). The model
|
| 142 |
is derived from upstream and project corpora; this release does not claim
|
| 143 |
ownership of source texts or other training materials. Upstream rights and
|
| 144 |
licensing conditions remain applicable.
|