| --- |
| license: bsd-3-clause |
| language: ar |
| inference: false |
| tags: |
| - secryst |
| - transliteration |
| - diacritization |
| - onnx |
| - byt5 |
| --- |
| |
| # ara-diac-plane-large-1.0 |
|
|
| Part of the [Secryst](https://secryst.github.io) phonological-layer family — a dedicated model for **diacritization** (AR), distributed as a Secryst IMF artifact and loadable through any Secryst crystal: |
|
|
| ```python |
| from secryst import Model |
| Model.load("ara-diac-plane-large-1.0") |
| ``` |
|
|
| - Artifact: `ara-diac-plane-large-1.0.zip` (0.81 GiB) |
|
|
| ## Measured quality |
|
|
| Full evaluation sets, zero skipped examples, the benchmark's own evaluator. Provenance for every number is the results record of the training project. |
|
|
| | metric | value | provenance | |
| |---|---|---| |
| | der_total_greedy | 2.7397 | interscript/interscript-ml docs/RESULTS.md#run-019-epoch-2--27397-second-epoch-closes-a-third-of-the-gap-sota-gate-still-open-2026-10-05 | |
| | der_morph_greedy | 1.6717 | interscript/interscript-ml docs/RESULTS.md#run-019-epoch-2--27397-second-epoch-closes-a-third-of-the-gap-sota-gate-still-open-2026-10-05 | |
| | wer_total_greedy | 8.6083 | interscript/interscript-ml docs/RESULTS.md#run-019-epoch-2--27397-second-epoch-closes-a-third-of-the-gap-sota-gate-still-open-2026-10-05 | |
|
|
| ## Benchmark |
|
|
| Full-set SadeedDiac-25 — 1,200 paragraphs, zero skipped, greedy decode |
| (protocol-matched, Misraj's evaluator): |
|
|
| | model | Total DER | notes | |
| |---|---|---| |
| | ara-diac-2.0 (teacher, 580M seq2seq) | 2.29% | best dedicated | |
| | **ara-diac-plane-large-1.0 (this model)** | **2.74%** | **866 MB int8** | |
| | Gemini-Flash-2.0 (frontier LLM) | 3.19% | | |
| | ara-diac-plane-1.0 (plane small) | 3.59% | 219 MB int8 | |
| | ara-diac-small-2.1 (seq2seq student) | 4.57% | 491 MB int8 | |
|
|
| The second-best dedicated system overall, ahead of Gemini-Flash, and |
| the best that ships as one self-contained int8 ONNX graph. Morph DER |
| 1.67% (iʿrāb quality); total WER 8.61%. |
|
|
| ## Architecture |
|
|
| Plane-factorized diacritization at the ByT5-LARGE encoder scale: a |
| byte-level encoder-only transformer (no decoder) with a diacritic-plane |
| embedding and one classification head over 54 haraqat classes per |
| character position. Decoding is K=2 mask-predict passes — parallel |
| forwards feeding the predicted plane back; no KV cache, no |
| autoregressive loop. Skeleton round-trip is byte-exact. |
|
|
| The artifact is a single self-contained int8 ONNX graph in the plane |
| zip contract (metadata.yaml with member sha256s + plane.onnx + |
| classes.json), loadable by secryst-py `PlaneModel.from_zip`. The |
| canonical distribution is the Secryst IMF artifact (sha256-verified); |
| this repository mirrors those exact bytes. |
|
|
| Provenance: rababa run-019, 2 epochs over 551k unique units. The |
| epoch-2 number is the corrected measurement — the first epoch-2 eval |
| silently re-scored epoch-1 predictions and was re-run in full (see the |
| interscript-ml RESULTS ledger). |
|
|
|
|
| ## License |
|
|
| BSD-3-CLAUSE |
|
|
| ## Provenance |
|
|
| Trained in the [Secryst training monorepo](https://github.com/secryst/secryst-train) and published through the [interscript-ml](https://github.com/interscript/interscript-ml) distribution contract (models.yaml index, sha256-verified release assets, parity-gated artifacts). The canonical download channel is GitHub Releases; this repository is the Hugging Face mirror of the same bytes, pinned to the index revision. |
|
|
