AbstractPhil commited on
Commit
396e62f
·
verified ·
1 Parent(s): 3802578

README: link exp013_aug campaign

Browse files
Files changed (1) hide show
  1. README.md +12 -0
README.md CHANGED
@@ -120,6 +120,18 @@ coefficient heads collapse at any dim); **sign-code task-parity** (3/3 seeds); t
120
  pressure. Full write-up: [exp012_ar/article.md](./exp012_ar/article.md) — 48-run
121
  ledger, 17 trained specimens, and the complete bed included.
122
 
 
 
 
 
 
 
 
 
 
 
 
 
123
  ## Relation to prior work
124
 
125
  Residual-expert quantization (RQ-MoE, SwitchCodec/REVQ), hierarchical
 
120
  pressure. Full write-up: [exp012_ar/article.md](./exp012_ar/article.md) — 48-run
121
  ledger, 17 trained specimens, and the complete bed included.
122
 
123
+ ## exp013 — augmenting pretrained models (July 10, 2026)
124
+
125
+ [`exp013_aug/`](./exp013_aug): the aleph structures applied to FROZEN pretrained
126
+ models. Headline: GPT-2 124M ppl 38.65 -> **26.53** with aleph relay adapters (1.18M
127
+ trainable) vs 27.26 for the param-matched MLP ablation — 2/2 seeds, with the gate
128
+ mechanism visible (aleph gates grow 3x from init, MLP gates shrink below it). Also:
129
+ the bottleneck prior is substrate-scoped (MLP wins frozen CLIP-L token-AR); the
130
+ layer law (penultimate is richer but nonlinearly coded); sign-code > soft read in
131
+ 12/12 pretrained-substrate cells; spelling-AR shows the address extracts more of the
132
+ surface residue that exists but conjures nothing absent. 18 specimens, all books
133
+ projective. Full ledger + write-up in [exp013_aug/README.md](./exp013_aug/README.md).
134
+
135
  ## Relation to prior work
136
 
137
  Residual-expert quantization (RQ-MoE, SwitchCodec/REVQ), hierarchical