============================================================================== PENDULUM second held-out draw (seed=321) ============================================================================== [pendulum plants (2nd draw)] seeds: 321 [pendulum diffusion] seeds: (0, 1, 2) [oracle] 10/40 plants done (24.6 s/plant avg) [oracle] 20/40 plants done (27.2 s/plant avg) [oracle] 30/40 plants done (27.0 s/plant avg) [oracle] 40/40 plants done (27.4 s/plant avg) [oracle] 40 plants in 1095s (27.4 s/plant) [oracle cached] -> results/baselines/pendulum_oracle_seed321.npz oracle_J finite for 40/40 plants diffusion generation: 35.43 ms/controller (mean over 3 seeds) === PENDULUM retrieval/interpolation baselines (N=40, seed=321) === verifier: certify_controller (regional LMI) + simulate_pendulum_batch rollout (n_ic=3, dt=0.02, duration=6.0, energy_thresh=0.02) oracle: FRESH (not previously cached): eval_pendulum.strong_oracle (24 restarts x 100 steps), computed this run and cached to results/baselines/pendulum_oracle_seed321.npz K_std=8, diffusion seeds=(0, 1, 2) --- K=8 --- arm cert_any stable_any persamp reg_med% reg_p90% reg_max% ms/plant McNemar(n10,n01,p) Wilcoxon(n,p) diffusion 1.00 1.00 1.00 0.97 2.21 3.17 283.48 (reference) (reference) (sd across 3 seeds: cert_any 0.000, stable_any 0.000, per-samp 0.000) (seed[0] 95% CI: stable_any [1.00,1.00] regret_med [+0.75,+1.31]%) retrieval 1.00 1.00 1.00 0.29 0.64 0.86 0.373 (0,0,1) (40,1e-07) (Wilcoxon n=40 = plants where BOTH this arm and diffusion have a finite cost, i.e. the COMMON success set, not either arm's own coverage count) (95% CI: stable_any [1.00,1.00] regret_med [+0.16,+0.36]%) interpolation 1.00 1.00 1.00 0.30 0.67 2.01 0.373 (0,0,1) (40,1e-07) (Wilcoxon n=40 = plants where BOTH this arm and diffusion have a finite cost, i.e. the COMMON success set, not either arm's own coverage count) (95% CI: stable_any [1.00,1.00] regret_med [+0.16,+0.42]%) --- K=1 --- arm cert_any stable_any persamp reg_med% reg_p90% reg_max% ms/plant McNemar(n10,n01,p) Wilcoxon(n,p) diffusion 1.00 1.00 1.00 1.55 3.37 5.05 283.48 (reference) (reference) (sd across 3 seeds: cert_any 0.000, stable_any 0.000, per-samp 0.000) (seed[0] 95% CI: stable_any [1.00,1.00] regret_med [+1.44,+1.94]%) retrieval 1.00 1.00 1.00 1.36 2.68 5.20 0.128 (0,0,1) (40,0.055) (Wilcoxon n=40 = plants where BOTH this arm and diffusion have a finite cost, i.e. the COMMON success set, not either arm's own coverage count) (95% CI: stable_any [1.00,1.00] regret_med [+1.14,+1.81]%) interpolation 1.00 1.00 1.00 1.36 2.68 5.20 0.128 (0,0,1) (40,0.055) (Wilcoxon n=40 = plants where BOTH this arm and diffusion have a finite cost, i.e. the COMMON success set, not either arm's own coverage count) (95% CI: stable_any [1.00,1.00] regret_med [+1.14,+1.81]%)