matCercola18 commited on
Commit
3f0e7f1
·
verified ·
1 Parent(s): 2e74467

X20b ablate report

Browse files
results/icml_r3/X20/ablate_report.npz ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:82add86d12142f687a9429cab046941190a162582964c843e0451d9632651b40
3
+ size 4175
results/icml_r3/X20/ablate_report.txt ADDED
@@ -0,0 +1,53 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ X20b: ablation of the X20 GO (results/icml_r3/X20/PREREG.md, X20b section); s1 only; J_ref = the X20 pilot reference
2
+ config {'starts': 16, 'steps': 400, 'ckpt_every': 25, 'lr': 0.1, 'bcap': 10000.0, 'bisect_iters': 10, 'dt': 0.03, 'f_margin': 0.01}
3
+ CIs: 95% percentile bootstrap over plants (10,000 resamples); Wilcoxon signed-rank, two-sided, on J_arm - J_ref.
4
+
5
+ PRIMARY F-only (phi = sat_1, F optimized): d = (J_arm - J_ref)/J_ref at s1: median 0.21% [-0.00, 1.41], mean 0.6% (d capped at 1e5% for the mean), Wilcoxon p = 0.781, n = 40; arm not certified on 0 plants; arm cheaper than J_ref on 14
6
+ secondary phi-only (F = HIFOO start, phi optimized): d = (J_arm - J_ref)/J_ref at s1: median 29.82% [22.36, 35.82], mean 40.7% (d capped at 1e5% for the mean), Wilcoxon p = 1.06e-07, n = 40; arm not certified on 0 plants; arm cheaper than J_ref on 2
7
+ secondary: F-only beats J_lin by >= 5% ((J_lin - J_Fonly)/J_Fonly >= 5%) on 87.5 [77.5, 97.5] (n=40) of plants
8
+ start match (16 accepted starts with the pilot's draw counts): 90.0 [80.0, 97.5] (n=40)
9
+ walk-back kept the verified start (A4): 2 starts; final iterate certified: F-only 70.7%, phi-only 91.1%
10
+
11
+ DECISION (X20b rule: shaping phi pays iff median d_Fonly >= 2% and CI lower bound > 0): shaping phi does NOT pay -> the dataset fixes phi = sat_1; the SISO claim is certified saturating dynamic controllers.
12
+
13
+ Per plant: i, J_ref (pilot), J_lin, J_Fonly, J_phionly, d_Fonly %, d_phionly %, start match
14
+ 0 0.07 0.1106 0.07066 0.09639 0.94 37.70 1
15
+ 1 0.4187 0.6274 0.3897 0.9893 -6.91 136.29 1
16
+ 2 0.1312 0.1843 0.135 0.1936 2.88 47.55 1
17
+ 3 0.2767 0.3249 0.2795 0.4717 1.01 70.46 1
18
+ 4 0.7096 0.8 0.6858 1.025 -3.35 44.42 1
19
+ 5 0.0927 0.1572 0.1105 0.1318 19.20 42.18 1
20
+ 6 1.455 1.567 1.361 2.116 -6.47 45.45 1
21
+ 7 0.1158 0.2377 0.12 0.1332 3.58 15.01 1
22
+ 8 0.05793 0.1007 0.07407 0.08254 27.87 42.49 1
23
+ 9 0.1021 0.1552 0.1026 0.1535 0.51 50.29 1
24
+ 10 0.07844 0.1372 0.08174 0.1071 4.21 36.60 1
25
+ 11 0.1623 0.2146 0.1623 0.2162 0.00 33.23 1
26
+ 12 0.1728 0.292 0.1853 0.2321 7.21 34.29 1
27
+ 13 0.4998 0.6494 0.4987 0.9954 -0.23 99.14 1
28
+ 14 0.06632 0.1095 0.07179 0.07988 8.25 20.44 1
29
+ 15 0.2685 0.297 0.2917 0.3003 8.65 11.85 1
30
+ 16 0.1398 0.1679 0.1476 0.1885 5.59 34.86 1
31
+ 17 0.1323 0.1727 0.1363 0.1643 2.98 24.18 1
32
+ 18 0.2385 0.2637 0.2385 1.079 0.00 352.51 1
33
+ 19 0.7719 0.8247 0.7704 0.9065 -0.20 17.43 1
34
+ 20 2.162 2.503 2.119 2.638 -1.99 22.00 1
35
+ 21 0.4491 0.4321 0.4249 0.4767 -5.39 6.14 1
36
+ 22 2.383 2.479 2.423 2.988 1.65 25.35 1
37
+ 23 0.06168 0.07602 0.06168 0.07784 0.00 26.20 1
38
+ 24 0.08776 0.08375 0.04047 0.07226 -53.89 -17.66 1
39
+ 25 2.155 2.309 2.1 2.531 -2.55 17.46 1
40
+ 26 0.02325 0.06497 0.02458 0.02939 5.70 26.38 1
41
+ 27 0.1381 0.2285 0.1387 0.184 0.43 33.29 1
42
+ 28 0.2483 0.3045 0.2481 0.3009 -0.09 21.20 1
43
+ 29 0.07799 0.184 0.07957 0.1375 2.03 76.37 1
44
+ 30 0.0198 0.04359 0.01965 0.02638 -0.73 33.26 0
45
+ 31 0.1876 0.1674 0.1876 0.1876 0.00 0.00 1
46
+ 32 0.2592 0.3143 0.2592 0.2706 0.00 4.42 0
47
+ 33 0.08704 0.2554 0.09192 0.11 5.61 26.42 1
48
+ 34 0.2059 0.4366 0.207 0.247 0.54 19.98 1
49
+ 35 0.1507 0.2178 0.1507 0.2035 -0.00 35.04 1
50
+ 36 1.738 1.805 1.721 1.872 -0.97 7.69 1
51
+ 37 0.2859 0.6263 0.2893 0.4305 1.16 50.57 0
52
+ 38 0.1558 0.1658 0.1558 0.1469 0.00 -5.74 1
53
+ 39 0.2919 0.3591 0.2776 0.3582 -4.90 22.71 0