Thibaut Forest Claude Opus 5 (1M context) commited on
Commit ·
24b7f13
1
Parent(s): 80003d7
Phase 57: bgkf-vs-public alignment check (3 sign flips; better than purge; vrel the one coherent cross-fleet signal)
Browse files- EXPERIMENTS.md +12 -0
EXPERIMENTS.md
CHANGED
|
@@ -3137,3 +3137,15 @@ scales with fleet size as designed). NEW DENOMINATION: per-test-fleet cost,
|
|
| 3137 |
never cross-compare with the full-fleet instruments (1972.0 purge / 1661.7
|
| 3138 |
self-fit). Harness runtime 22s - cheap enough to run per candidate without
|
| 3139 |
triage subsets.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3137 |
never cross-compare with the full-fleet instruments (1972.0 purge / 1661.7
|
| 3138 |
self-fit). Harness runtime 22s - cheap enough to run per candidate without
|
| 3139 |
triage subsets.
|
| 3140 |
+
|
| 3141 |
+
Phase 57 alignment check vs recorded public scores (user request; pooling
|
| 3142 |
+
arm killed mid-run): champion 352.0 reference; cert-first bgkf -7.3+/-4.3 vs
|
| 3143 |
+
public +43 (flip); frontier -5.3+/-7.4 vs public +216 (flip, but far less
|
| 3144 |
+
fooled than the purge's -342, and it reproduces the public swap-count-drop
|
| 3145 |
+
direction); alpha 1.5 -28.8+/-13.6 at swaps 3.15 vs public +527 (flip -
|
| 3146 |
+
still rewards appetite; note 65W/118L, the count-asymmetry signature).
|
| 3147 |
+
Verdict: better than the purge, still sign-flips all three public killers -
|
| 3148 |
+
fleet-composition facts (uncatchable public tail, train-absent ghosts) are
|
| 3149 |
+
invisible to ANY local split. The structural shipping bar (flat swaps per
|
| 3150 |
+
cell, no label-process exploits) remains the only local defense. One
|
| 3151 |
+
coherent cross-fleet signal: vrel -13.4+/-7.9, 104W/61L, swaps flat.
|