rhtse commited on
Commit
61cf91f
·
verified ·
1 Parent(s): 73d100d

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +71 -0
README.md ADDED
@@ -0,0 +1,71 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: bsd-3-clause
3
+ language: ar
4
+ inference: false
5
+ tags:
6
+ - secryst
7
+ - transliteration
8
+ - diacritization
9
+ - onnx
10
+ - byt5
11
+ ---
12
+
13
+ # ara-diac-2.0
14
+
15
+ Part of the [Secryst](https://secryst.github.io) phonological-layer family — a dedicated model for **diacritization** (AR), distributed as a Secryst IMF artifact and loadable through any Secryst crystal:
16
+
17
+ ```python
18
+ from secryst import Model
19
+ Model.load("ara-diac-2.0")
20
+ ```
21
+
22
+ - Artifact: `ara-diac-2.0-fp32.zip` (2.59 GiB)
23
+ - Precision variants: `ara-diac-2.0-int8`
24
+
25
+ ## Measured quality
26
+
27
+ Full evaluation sets, zero skipped examples, the benchmark's own evaluator. Provenance for every number is the results record of the training project.
28
+
29
+ | metric | value | provenance |
30
+ |---|---|---|
31
+ | der_total_greedy | 2.2864 | rababa/docs/RESULTS.md#r7-verdict-table-sadeeddiac-25-2026-08-28 |
32
+ | der_morph_greedy | 1.3343 | rababa/docs/RESULTS.md#r7-verdict-table-sadeeddiac-25-2026-08-28 |
33
+ | wer_wikinews_multiref | 17.3794 | rababa/docs/RESULTS.md#r7-ood-verdict-table-wikinews-2024-multiref-2026-08-28 |
34
+ | der_wikinews_multiref | 11.8273 | rababa/docs/RESULTS.md#r7-ood-verdict-table-wikinews-2024-multiref-2026-08-28 |
35
+
36
+ ## Benchmark
37
+
38
+ SadeedDiac-25 — full 1,200-paragraph set, Misraj's evaluator, zero
39
+ skipped examples, greedy decode (protocol-matched published numbers
40
+ only):
41
+
42
+ | system | Total DER | kind |
43
+ |---|---|---|
44
+ | Claude-3.7-Sonnet | 1.39% | frontier LLM |
45
+ | **ara-diac-2.0 (this model)** | **2.29%** | dedicated, 580M |
46
+ | GLM-5.2 | 2.69% | frontier LLM |
47
+ | Gemini-Flash-2.0 | 3.19% | frontier LLM |
48
+ | GPT-4 | 3.86% | frontier LLM |
49
+ | Sadeed-1.5B | 7.29% | leaderboard baseline |
50
+
51
+ Word-final iʿrāb endings (the hardest component): 1.33% DER.
52
+ Out-of-domain generalization (WikiNews-2024 multi-reference):
53
+ 17.38 WER / 11.83 DER.
54
+
55
+ ## Architecture
56
+
57
+ ByT5-large-class seq2seq transformer (580M parameters), byte-level
58
+ input/output (no tokenizer — id = byte + 3). Trained on classical and
59
+ modern Arabic running text with a news-domain adaptation stage over a
60
+ morphology-auxiliary curriculum. The canonical distribution is the
61
+ Secryst IMF artifact (sha256-verified, parity-gated against the
62
+ PyTorch reference); this repository mirrors those exact bytes.
63
+
64
+
65
+ ## License
66
+
67
+ BSD-3-CLAUSE
68
+
69
+ ## Provenance
70
+
71
+ Trained in the [Secryst training monorepo](https://github.com/secryst/secryst-train) and published through the [interscript-ml](https://github.com/interscript/interscript-ml) distribution contract (models.yaml index, sha256-verified release assets, parity-gated artifacts). The canonical download channel is GitHub Releases; this repository is the Hugging Face mirror of the same bytes, pinned to the index revision.