README: link exp013_aug campaign
Browse files
README.md
CHANGED
|
@@ -120,6 +120,18 @@ coefficient heads collapse at any dim); **sign-code task-parity** (3/3 seeds); t
|
|
| 120 |
pressure. Full write-up: [exp012_ar/article.md](./exp012_ar/article.md) — 48-run
|
| 121 |
ledger, 17 trained specimens, and the complete bed included.
|
| 122 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 123 |
## Relation to prior work
|
| 124 |
|
| 125 |
Residual-expert quantization (RQ-MoE, SwitchCodec/REVQ), hierarchical
|
|
|
|
| 120 |
pressure. Full write-up: [exp012_ar/article.md](./exp012_ar/article.md) — 48-run
|
| 121 |
ledger, 17 trained specimens, and the complete bed included.
|
| 122 |
|
| 123 |
+
## exp013 — augmenting pretrained models (July 10, 2026)
|
| 124 |
+
|
| 125 |
+
[`exp013_aug/`](./exp013_aug): the aleph structures applied to FROZEN pretrained
|
| 126 |
+
models. Headline: GPT-2 124M ppl 38.65 -> **26.53** with aleph relay adapters (1.18M
|
| 127 |
+
trainable) vs 27.26 for the param-matched MLP ablation — 2/2 seeds, with the gate
|
| 128 |
+
mechanism visible (aleph gates grow 3x from init, MLP gates shrink below it). Also:
|
| 129 |
+
the bottleneck prior is substrate-scoped (MLP wins frozen CLIP-L token-AR); the
|
| 130 |
+
layer law (penultimate is richer but nonlinearly coded); sign-code > soft read in
|
| 131 |
+
12/12 pretrained-substrate cells; spelling-AR shows the address extracts more of the
|
| 132 |
+
surface residue that exists but conjures nothing absent. 18 specimens, all books
|
| 133 |
+
projective. Full ledger + write-up in [exp013_aug/README.md](./exp013_aug/README.md).
|
| 134 |
+
|
| 135 |
## Relation to prior work
|
| 136 |
|
| 137 |
Residual-expert quantization (RQ-MoE, SwitchCodec/REVQ), hierarchical
|