Upload README.md with huggingface_hub
Browse files
README.md
ADDED
|
@@ -0,0 +1,71 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: bsd-3-clause
|
| 3 |
+
language: ar
|
| 4 |
+
inference: false
|
| 5 |
+
tags:
|
| 6 |
+
- secryst
|
| 7 |
+
- transliteration
|
| 8 |
+
- diacritization
|
| 9 |
+
- onnx
|
| 10 |
+
- byt5
|
| 11 |
+
---
|
| 12 |
+
|
| 13 |
+
# ara-diac-2.0
|
| 14 |
+
|
| 15 |
+
Part of the [Secryst](https://secryst.github.io) phonological-layer family — a dedicated model for **diacritization** (AR), distributed as a Secryst IMF artifact and loadable through any Secryst crystal:
|
| 16 |
+
|
| 17 |
+
```python
|
| 18 |
+
from secryst import Model
|
| 19 |
+
Model.load("ara-diac-2.0")
|
| 20 |
+
```
|
| 21 |
+
|
| 22 |
+
- Artifact: `ara-diac-2.0-fp32.zip` (2.59 GiB)
|
| 23 |
+
- Precision variants: `ara-diac-2.0-int8`
|
| 24 |
+
|
| 25 |
+
## Measured quality
|
| 26 |
+
|
| 27 |
+
Full evaluation sets, zero skipped examples, the benchmark's own evaluator. Provenance for every number is the results record of the training project.
|
| 28 |
+
|
| 29 |
+
| metric | value | provenance |
|
| 30 |
+
|---|---|---|
|
| 31 |
+
| der_total_greedy | 2.2864 | rababa/docs/RESULTS.md#r7-verdict-table-sadeeddiac-25-2026-08-28 |
|
| 32 |
+
| der_morph_greedy | 1.3343 | rababa/docs/RESULTS.md#r7-verdict-table-sadeeddiac-25-2026-08-28 |
|
| 33 |
+
| wer_wikinews_multiref | 17.3794 | rababa/docs/RESULTS.md#r7-ood-verdict-table-wikinews-2024-multiref-2026-08-28 |
|
| 34 |
+
| der_wikinews_multiref | 11.8273 | rababa/docs/RESULTS.md#r7-ood-verdict-table-wikinews-2024-multiref-2026-08-28 |
|
| 35 |
+
|
| 36 |
+
## Benchmark
|
| 37 |
+
|
| 38 |
+
SadeedDiac-25 — full 1,200-paragraph set, Misraj's evaluator, zero
|
| 39 |
+
skipped examples, greedy decode (protocol-matched published numbers
|
| 40 |
+
only):
|
| 41 |
+
|
| 42 |
+
| system | Total DER | kind |
|
| 43 |
+
|---|---|---|
|
| 44 |
+
| Claude-3.7-Sonnet | 1.39% | frontier LLM |
|
| 45 |
+
| **ara-diac-2.0 (this model)** | **2.29%** | dedicated, 580M |
|
| 46 |
+
| GLM-5.2 | 2.69% | frontier LLM |
|
| 47 |
+
| Gemini-Flash-2.0 | 3.19% | frontier LLM |
|
| 48 |
+
| GPT-4 | 3.86% | frontier LLM |
|
| 49 |
+
| Sadeed-1.5B | 7.29% | leaderboard baseline |
|
| 50 |
+
|
| 51 |
+
Word-final iʿrāb endings (the hardest component): 1.33% DER.
|
| 52 |
+
Out-of-domain generalization (WikiNews-2024 multi-reference):
|
| 53 |
+
17.38 WER / 11.83 DER.
|
| 54 |
+
|
| 55 |
+
## Architecture
|
| 56 |
+
|
| 57 |
+
ByT5-large-class seq2seq transformer (580M parameters), byte-level
|
| 58 |
+
input/output (no tokenizer — id = byte + 3). Trained on classical and
|
| 59 |
+
modern Arabic running text with a news-domain adaptation stage over a
|
| 60 |
+
morphology-auxiliary curriculum. The canonical distribution is the
|
| 61 |
+
Secryst IMF artifact (sha256-verified, parity-gated against the
|
| 62 |
+
PyTorch reference); this repository mirrors those exact bytes.
|
| 63 |
+
|
| 64 |
+
|
| 65 |
+
## License
|
| 66 |
+
|
| 67 |
+
BSD-3-CLAUSE
|
| 68 |
+
|
| 69 |
+
## Provenance
|
| 70 |
+
|
| 71 |
+
Trained in the [Secryst training monorepo](https://github.com/secryst/secryst-train) and published through the [interscript-ml](https://github.com/interscript/interscript-ml) distribution contract (models.yaml index, sha256-verified release assets, parity-gated artifacts). The canonical download channel is GitHub Releases; this repository is the Hugging Face mirror of the same bytes, pinned to the index revision.
|