Card: state corpus provenance and what is released
Browse files
README.md
CHANGED
|
@@ -126,7 +126,13 @@ characters it introduces, where the training corpus abandons 0.0%.
|
|
| 126 |
|
| 127 |
The corpus is synthetic, generated by two teacher models: **ALLaM 2.7B** (75%) and
|
| 128 |
**Qwen3.6-27B** (25%), with quality gates rejecting foreign characters and template
|
| 129 |
-
openings.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 130 |
|
| 131 |
---
|
| 132 |
|
|
@@ -148,7 +154,8 @@ Capacity buys coherence, not vocabulary.
|
|
| 148 |
## Paper
|
| 149 |
|
| 150 |
<!-- TODO: arXiv link on release -->
|
| 151 |
-
*In preparation.*
|
|
|
|
| 152 |
|
| 153 |
```bibtex
|
| 154 |
@misc{binsafi2026ruqlm,
|
|
|
|
| 126 |
|
| 127 |
The corpus is synthetic, generated by two teacher models: **ALLaM 2.7B** (75%) and
|
| 128 |
**Qwen3.6-27B** (25%), with quality gates rejecting foreign characters and template
|
| 129 |
+
openings. Both teachers are Apache-2.0.
|
| 130 |
+
|
| 131 |
+
The generated stories are **not redistributed**: they were produced through a
|
| 132 |
+
commercial inference API whose terms restrict building redistributable databases
|
| 133 |
+
from model output. What is released instead is the *generator* — seed space, prompt
|
| 134 |
+
templates, quality gates and sampling procedure. Generation is deterministic given a
|
| 135 |
+
seed, so the corpus is reproducible from what is published.
|
| 136 |
|
| 137 |
---
|
| 138 |
|
|
|
|
| 154 |
## Paper
|
| 155 |
|
| 156 |
<!-- TODO: arXiv link on release -->
|
| 157 |
+
*In preparation.* Metrics, checkpoints, tokenizer, generation seeds and every
|
| 158 |
+
measurement are released.
|
| 159 |
|
| 160 |
```bibtex
|
| 161 |
@misc{binsafi2026ruqlm,
|