X20b ablate report
Browse files
results/icml_r3/X20/ablate_report.npz
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:82add86d12142f687a9429cab046941190a162582964c843e0451d9632651b40
|
| 3 |
+
size 4175
|
results/icml_r3/X20/ablate_report.txt
ADDED
|
@@ -0,0 +1,53 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
X20b: ablation of the X20 GO (results/icml_r3/X20/PREREG.md, X20b section); s1 only; J_ref = the X20 pilot reference
|
| 2 |
+
config {'starts': 16, 'steps': 400, 'ckpt_every': 25, 'lr': 0.1, 'bcap': 10000.0, 'bisect_iters': 10, 'dt': 0.03, 'f_margin': 0.01}
|
| 3 |
+
CIs: 95% percentile bootstrap over plants (10,000 resamples); Wilcoxon signed-rank, two-sided, on J_arm - J_ref.
|
| 4 |
+
|
| 5 |
+
PRIMARY F-only (phi = sat_1, F optimized): d = (J_arm - J_ref)/J_ref at s1: median 0.21% [-0.00, 1.41], mean 0.6% (d capped at 1e5% for the mean), Wilcoxon p = 0.781, n = 40; arm not certified on 0 plants; arm cheaper than J_ref on 14
|
| 6 |
+
secondary phi-only (F = HIFOO start, phi optimized): d = (J_arm - J_ref)/J_ref at s1: median 29.82% [22.36, 35.82], mean 40.7% (d capped at 1e5% for the mean), Wilcoxon p = 1.06e-07, n = 40; arm not certified on 0 plants; arm cheaper than J_ref on 2
|
| 7 |
+
secondary: F-only beats J_lin by >= 5% ((J_lin - J_Fonly)/J_Fonly >= 5%) on 87.5 [77.5, 97.5] (n=40) of plants
|
| 8 |
+
start match (16 accepted starts with the pilot's draw counts): 90.0 [80.0, 97.5] (n=40)
|
| 9 |
+
walk-back kept the verified start (A4): 2 starts; final iterate certified: F-only 70.7%, phi-only 91.1%
|
| 10 |
+
|
| 11 |
+
DECISION (X20b rule: shaping phi pays iff median d_Fonly >= 2% and CI lower bound > 0): shaping phi does NOT pay -> the dataset fixes phi = sat_1; the SISO claim is certified saturating dynamic controllers.
|
| 12 |
+
|
| 13 |
+
Per plant: i, J_ref (pilot), J_lin, J_Fonly, J_phionly, d_Fonly %, d_phionly %, start match
|
| 14 |
+
0 0.07 0.1106 0.07066 0.09639 0.94 37.70 1
|
| 15 |
+
1 0.4187 0.6274 0.3897 0.9893 -6.91 136.29 1
|
| 16 |
+
2 0.1312 0.1843 0.135 0.1936 2.88 47.55 1
|
| 17 |
+
3 0.2767 0.3249 0.2795 0.4717 1.01 70.46 1
|
| 18 |
+
4 0.7096 0.8 0.6858 1.025 -3.35 44.42 1
|
| 19 |
+
5 0.0927 0.1572 0.1105 0.1318 19.20 42.18 1
|
| 20 |
+
6 1.455 1.567 1.361 2.116 -6.47 45.45 1
|
| 21 |
+
7 0.1158 0.2377 0.12 0.1332 3.58 15.01 1
|
| 22 |
+
8 0.05793 0.1007 0.07407 0.08254 27.87 42.49 1
|
| 23 |
+
9 0.1021 0.1552 0.1026 0.1535 0.51 50.29 1
|
| 24 |
+
10 0.07844 0.1372 0.08174 0.1071 4.21 36.60 1
|
| 25 |
+
11 0.1623 0.2146 0.1623 0.2162 0.00 33.23 1
|
| 26 |
+
12 0.1728 0.292 0.1853 0.2321 7.21 34.29 1
|
| 27 |
+
13 0.4998 0.6494 0.4987 0.9954 -0.23 99.14 1
|
| 28 |
+
14 0.06632 0.1095 0.07179 0.07988 8.25 20.44 1
|
| 29 |
+
15 0.2685 0.297 0.2917 0.3003 8.65 11.85 1
|
| 30 |
+
16 0.1398 0.1679 0.1476 0.1885 5.59 34.86 1
|
| 31 |
+
17 0.1323 0.1727 0.1363 0.1643 2.98 24.18 1
|
| 32 |
+
18 0.2385 0.2637 0.2385 1.079 0.00 352.51 1
|
| 33 |
+
19 0.7719 0.8247 0.7704 0.9065 -0.20 17.43 1
|
| 34 |
+
20 2.162 2.503 2.119 2.638 -1.99 22.00 1
|
| 35 |
+
21 0.4491 0.4321 0.4249 0.4767 -5.39 6.14 1
|
| 36 |
+
22 2.383 2.479 2.423 2.988 1.65 25.35 1
|
| 37 |
+
23 0.06168 0.07602 0.06168 0.07784 0.00 26.20 1
|
| 38 |
+
24 0.08776 0.08375 0.04047 0.07226 -53.89 -17.66 1
|
| 39 |
+
25 2.155 2.309 2.1 2.531 -2.55 17.46 1
|
| 40 |
+
26 0.02325 0.06497 0.02458 0.02939 5.70 26.38 1
|
| 41 |
+
27 0.1381 0.2285 0.1387 0.184 0.43 33.29 1
|
| 42 |
+
28 0.2483 0.3045 0.2481 0.3009 -0.09 21.20 1
|
| 43 |
+
29 0.07799 0.184 0.07957 0.1375 2.03 76.37 1
|
| 44 |
+
30 0.0198 0.04359 0.01965 0.02638 -0.73 33.26 0
|
| 45 |
+
31 0.1876 0.1674 0.1876 0.1876 0.00 0.00 1
|
| 46 |
+
32 0.2592 0.3143 0.2592 0.2706 0.00 4.42 0
|
| 47 |
+
33 0.08704 0.2554 0.09192 0.11 5.61 26.42 1
|
| 48 |
+
34 0.2059 0.4366 0.207 0.247 0.54 19.98 1
|
| 49 |
+
35 0.1507 0.2178 0.1507 0.2035 -0.00 35.04 1
|
| 50 |
+
36 1.738 1.805 1.721 1.872 -0.97 7.69 1
|
| 51 |
+
37 0.2859 0.6263 0.2893 0.4305 1.16 50.57 0
|
| 52 |
+
38 0.1558 0.1658 0.1558 0.1469 0.00 -5.74 1
|
| 53 |
+
39 0.2919 0.3591 0.2776 0.3582 -4.90 22.71 0
|