failed09 commited on
Commit
d26e094
Β·
verified Β·
1 Parent(s): 5cb1dd5

docs: format Method pipeline as tree

Browse files
Files changed (1) hide show
  1. README.md +6 -3
README.md CHANGED
@@ -72,8 +72,11 @@ form was never seen during training.
72
  ## Method
73
 
74
  ```text
75
- monolingual Bashkir text β†’ Unicode NFC tokenization β†’ skip-gram 300d (char n-grams 3–6)
76
- β†’ prune (top-50k words, top-100k subwords) β†’ PQ FP16 β†’ mini .bin
 
 
 
77
  ```
78
 
79
  The model was trained from a monolingual Bashkir-language dataset.
@@ -135,7 +138,7 @@ print(model.similarity("Π°Ρ‚Π°ΠΉ", "әсәй"))
135
  ## License
136
 
137
  The model and release code are provided under the
138
- [Apache-2.0 license](https://huggingface.co/failed09/bashkir-fasttext/blob/main/LICENSE). The model
139
  is derived from upstream and project corpora; this release does not claim
140
  ownership of source texts or other training materials. Upstream rights and
141
  licensing conditions remain applicable.
 
72
  ## Method
73
 
74
  ```text
75
+ monolingual Bashkir text (clean corpus)
76
+ β”œβ”€β”€ 1. Unicode NFC tokenization preserving 9 Bashkir letters
77
+ β”œβ”€β”€ 2. train skip-gram 300d with subword character n-grams (3–6)
78
+ β”œβ”€β”€ 3. prune vocabulary to top-50k words and top-100k subwords
79
+ └── 4. product quantization (PQ FP16) export to mini .bin
80
  ```
81
 
82
  The model was trained from a monolingual Bashkir-language dataset.
 
138
  ## License
139
 
140
  The model and release code are provided under the
141
+ [Apache-2.0 license](https://huggingface.co/failed09/bashkir-fasttext/blob/main/LICENSE). The model
142
  is derived from upstream and project corpora; this release does not claim
143
  ownership of source texts or other training materials. Upstream rights and
144
  licensing conditions remain applicable.