| license: bsd-3-clause | |
| language: | |
| - fa | |
| tags: | |
| - diacritization | |
| - byt5 | |
| - imf | |
| - persian | |
| metrics: | |
| - cer | |
| # fas-diac-base-1.0 | |
| Persian diacritization, base tier (run-077): byt5-small seq2seq on | |
| the 445,869-pair HomoRich-derived corpus (CC0-1.0). IMF v1 fp16. | |
| ## Metrics (9,288-row docs split — byte-identical to the rababa-farsi | |
| reference split; raw char CER, both conventions) | |
| Row-mean CER **0.603%** · corpus-level CER 0.777% · word accuracy | |
| **82.33%**. The historical 0.52% line is corpus-level under run-001's | |
| undocumented recipe and does not reproduce (five controlled arms, | |
| WO47); this is the best verified number. | |
| ## Improvement history (all closed with data) | |
| epochs (3→6: 0.65→0.60) · backbone (small/base) · optimizer (docs-exact | |
| 5e-4/linear) · metric convention (row-mean vs corpus) · multi-arm | |
| oracle distillation (run-080/081: arms too correlated, 10.0% | |
| disagreement — MISS). Remaining untried: corpus rebuild to the raw | |
| 528,837 rows. | |
| ## License | |
| Training data: HomoRich-G2P-Persian, **CC0-1.0** (verified via HF | |
| cardData). Weights and code: BSD-3-Clause. | |