Card 1.08b: pre-registered metric (all 360 items) first

README.md

@@ -111,12 +111,12 @@ least 4 of 7 non-binary tasks above zero. It reached 7.74% (24/310) with exactly
 
 | pass@1 on held-out v2 | 1.07 (22327) | 1.08b | 1.08b control |
 |---|---:|---:|---:|
-| 310 non-binary items | 7.74% | 6.45% | 8.39% |
-| all 360 items | 13.3% | 9.7% | 15.6% |
+| all 360 items (pre-registered metric) | 13.3% | 9.7% | 15.6% |
+| 310 non-binary items (validity-condition subset) | 7.74% | 6.45% | 8.39% |
 | arithmetic (46 items) | 2/46 | 3/46 | 3/46 |
 
-- **No measurable reasoning gain.** 1.08b vs control on the non-binary items: −1.94 pp, 95% CI [−5.48, +1.61]; on all
-  360 items 9.7% vs 15.6%. The sensitivity of this set is low.
+- **No measurable reasoning gain.** On all 360 items (pre-registered metric): 1.08b 9.7% vs control 15.6% (−5.8 pp).
+  Variant on the 310 non-binary items: −1.94 pp, 95% CI [−5.48, +1.61]. The sensitivity of this set is low.
 - On the 50 yes/no syllogism items (gold: 14 No, 36 Yes), 1.08b answered No 49 times, the control 16 and 1.07 24; in
   this single run this accounts for most of the gap. None of the models beats the always-Yes baseline on these 50
   syllogism items (post-hoc, single run).