docs/technical/04_the_head.md: paraphrase the program lead's directives (no inline quotations)
Browse files
docs/technical/04_the_head.md
CHANGED
|
@@ -30,7 +30,7 @@ The s8 row is a **retraction stated where it fell**: the curriculum_s8 report ra
|
|
| 30 |
|
| 31 |
**(2026-08-31 β 09-04: the third craft.)** The softmax twin of section 5 trained its born-null head with a *free* address for its whole life β a near-miss fixed in 0.8.7 before launch, since it would otherwise have inherited the treatment's frozen address and been buried by construction. Its head-off toggle never left Β±1.1e-5 at any boundary report through 16.1B tokens (+5.9e-6 at 1,145 to β1.06e-5 at 61,422; fourteen rows, one craft). Liveness read 0.23Γ at step 500, 0.0295Γ by 3,000 (buried flag set from 3,000 through 61,000), 0.0098Γ at 38,000, 0.028Γ at 60,500; W_s climbed 13 β 127 on nothing; consumed rank reached 66β103 mid-run β structure without function. **Born-null self-burial is a statute at 3/3 crafts (S-1002)**: regardless of governor, address freezing, attention family or scale, a weight-zero aleph head racing a same-target linear base buries within ~2,000 steps. The 08-30 selection-mechanism review named the precondition structural: abstention and burial are the *same* geometry in the signed read; hubs never buried because attention *is* their read β no bypass β while the head races a parallel path.
|
| 32 |
|
| 33 |
-
**(2026-08-31: the cultivation screen.)** Phil's question: can the head be cultivated
|
| 34 |
|
| 35 |
**(2026-08-31, 13:49 β 23:42: born with function, and its price.)** Phil designated the v3 doctrine mid-screen β heads born live, address frozen so burial is structurally impossible β and D tightened it to born *with function*: address construction plus the birth ridge, or a matured warm-start. The owed supplement ran that night on the local 4090 (B2; fineweb-edu validation over 32,768 positions, micro 2, seed 1337, 1,200 steps): born-null A 3.1576 β 3.0750 bpb with head toggle within 3e-5 of zero; born-live B 3.1740 β 3.0968 with the head carrying **+2.2343 bpb** of the model's function. B led at 900 steps (3.1340 vs 3.1369) and finished **+0.0218 worse** β one seed, a candidate: **born-live relocates labor at a small early tax**; the doctrine keeps its structural justification (guaranteed participation, transplantability, conditioning-facing roles) and loses the free lunch. Whether a trunk co-organized around a live head pays later is a full-run question with no data; arm C has no full-gauge number. Two grading inconsistencies stand: the law-family file carries S-1002 as candidate rows beside the statute, and grades B2 a law where both dockets say candidate.
|
| 36 |
|
|
|
|
| 30 |
|
| 31 |
**(2026-08-31 β 09-04: the third craft.)** The softmax twin of section 5 trained its born-null head with a *free* address for its whole life β a near-miss fixed in 0.8.7 before launch, since it would otherwise have inherited the treatment's frozen address and been buried by construction. Its head-off toggle never left Β±1.1e-5 at any boundary report through 16.1B tokens (+5.9e-6 at 1,145 to β1.06e-5 at 61,422; fourteen rows, one craft). Liveness read 0.23Γ at step 500, 0.0295Γ by 3,000 (buried flag set from 3,000 through 61,000), 0.0098Γ at 38,000, 0.028Γ at 60,500; W_s climbed 13 β 127 on nothing; consumed rank reached 66β103 mid-run β structure without function. **Born-null self-burial is a statute at 3/3 crafts (S-1002)**: regardless of governor, address freezing, attention family or scale, a weight-zero aleph head racing a same-target linear base buries within ~2,000 steps. The 08-30 selection-mechanism review named the precondition structural: abstention and burial are the *same* geometry in the signed read; hubs never buried because attention *is* their read β no bypass β while the head races a parallel path.
|
| 32 |
|
| 33 |
+
**(2026-08-31: the cultivation screen.)** Phil's question: can the head be cultivated from baseline within a thousand steps or so with the new head state, or does it need an architectural change. Four fresh 237M crafts on the mission card (wikitext-103, ctx 4,096, micro 8, seed 1337, 1,200 steps, gauges every 300 on a light 32,768-position val slice; one seed): **A**, born null β buried at the first gauge, liveness 0.089Γ β 0.045Γ, toggle within 1.1e-5 of zero, W_s 9 β 18; **B**, the revival op at step 0 (birth ridge β2.95 against an untrained base, alpha 16, W_s 6,345) β toggle +3.27 β +3.50, liveness 0.975Γ β 1.125Γ; **C**, the finished craft's 61,422 head transplanted (projection, book, W_s; not w_h) onto a newborn β +0.0375 β +0.0498 β +0.0723 β +0.0922 (monotone, accelerating), liveness 1.56Γ β 2.16Γ, W_s 516.5 β 520.5; **D**, B's address with W_s zeroed β toggle between β1.2e-4 and β4.6e-5, the address alive at 1.03β1.05Γ. D is decisive: **weight-zero cannot bootstrap against the linear base even without burial; the solve is mandatory.** B and C carried and grew: architecture acquitted, bottleneck rung deprioritized. Two caveats: the op fits on the validation batches the gauges later use (surviving inflation unmeasured), and B's toggle measures relocation β at birth the solved head is the primary readout.
|
| 34 |
|
| 35 |
**(2026-08-31, 13:49 β 23:42: born with function, and its price.)** Phil designated the v3 doctrine mid-screen β heads born live, address frozen so burial is structurally impossible β and D tightened it to born *with function*: address construction plus the birth ridge, or a matured warm-start. The owed supplement ran that night on the local 4090 (B2; fineweb-edu validation over 32,768 positions, micro 2, seed 1337, 1,200 steps): born-null A 3.1576 β 3.0750 bpb with head toggle within 3e-5 of zero; born-live B 3.1740 β 3.0968 with the head carrying **+2.2343 bpb** of the model's function. B led at 900 steps (3.1340 vs 3.1369) and finished **+0.0218 worse** β one seed, a candidate: **born-live relocates labor at a small early tax**; the doctrine keeps its structural justification (guaranteed participation, transplantability, conditioning-facing roles) and loses the free lunch. Whether a trunk co-organized around a live head pays later is a full-run question with no data; arm C has no full-gauge number. Two grading inconsistencies stand: the law-family file carries S-1002 as candidate rows beside the statute, and grades B2 a law where both dockets say candidate.
|
| 36 |
|