seeds: plants 321 777 | model torch seeds seed*1000+rho_idx for (0, 1, 2) | pool M = 32 [draw] plants seed=321 model seeds=(0, 1, 2) oracle ready (174s), found [40 40 40] of 40 /home/cercola/matte_server/DiffusionControl/nonlinear/data_generation/pendulum_lmi.py:149: UserWarning: Solution may be inaccurate. Try another solver, adjusting the solver settings, or solve with verbose=True for more information. prob.solve(solver=solver, verbose=False) rho=0.7 done (276s) rho=0.8 done (364s) rho=0.9 done (448s) [draw] plants seed=777 model seeds=(0, 1, 2) oracle ready (157s), found [40 40 40] of 40 rho=0.7 done (176s) rho=0.8 done (190s) rho=0.9 done (204s) RETRIEVAL vs OBJECTIVE-CONDITIONED GENERATION (pendulum) N=40 plants/draw, rho=(0.7, 0.8, 0.9), K in (8,1), steer S=50 plant seeds: main=321 (exp_cbar_eval's), second=777; model torch seeds = seed*1000+rho_idx, seeds (0, 1, 2) retr_b pool M=32. spec tolerance ise<=1.05*rho*ISE_ref (exp_cbar_eval satisfied_mask). == Task 1: stream replica of exp_cbar_eval (seed 321) vs STORED results/pendulum/cbar_eval.json == rho=0.7: bestof8 replica met 1.000 cert 1.000 reg 0.84 | stored met 1.000 cert 1.000 reg 0.83 || single replica met 0.925 cert 0.925 reg 8.83 | stored met 0.950 cert 0.850 reg 8.25 rho=0.8: bestof8 replica met 1.000 cert 1.000 reg 0.61 | stored met 1.000 cert 1.000 reg 0.66 || single replica met 0.900 cert 0.850 reg 5.83 | stored met 0.900 cert 0.875 reg 6.17 rho=0.9: bestof8 replica met 1.000 cert 1.000 reg 0.90 | stored met 1.000 cert 1.000 reg 1.51 || single replica met 0.875 cert 0.850 reg 4.26 | stored met 0.850 cert 0.850 reg 5.22 oracle found per rho: [40, 40, 40] --- MAIN DRAW seed 321: K=8 steer=none --- rows: rho | arm | spec-met | certified | regret% median [95% CI] p90 n (model = mean±sd over 3 seeds; CI/p90 from seed 0) [0.7 ] model met 1.000±0.000 cert 1.000±0.000 medreg 0.82±0.96 | seed0: 2.17 [ 0.66, 4.42] p90 11.80 n=40 [0.7 ] retr_a met 1.000 cert 1.000 medreg 1.05 [-0.13, 2.47] p90 9.54 n=40 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=0.0793 | p over seeds (McN,Wil): 1,0.079; 1,0.29; 1,0.38 [0.7 ] retr_b met 1.000 cert 1.000 medreg 1.05 [ 0.16, 2.49] p90 8.38 n=40 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=0.0548 | p over seeds (McN,Wil): 1,0.055; 1,0.83; 1,0.16 [0.7 ] retr_c met 1.000 cert 1.000 medreg 1.11 [-0.58, 2.07] p90 7.96 n=40 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=0.025 | p over seeds (McN,Wil): 1,0.025; 1,0.21; 1,0.17 [0.8 ] model met 1.000±0.000 cert 1.000±0.000 medreg 0.34±0.42 | seed0: -0.25 [-0.80, 0.98] p90 16.59 n=40 [0.8 ] retr_a met 1.000 cert 1.000 medreg 0.82 [-0.46, 2.05] p90 6.89 n=40 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=0.444 | p over seeds (McN,Wil): 1,0.44; 1,0.24; 1,0.082 [0.8 ] retr_b met 1.000 cert 1.000 medreg 0.38 [-0.79, 1.95] p90 9.84 n=40 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=0.334 | p over seeds (McN,Wil): 1,0.33; 1,0.23; 1,0.097 [0.8 ] retr_c met 1.000 cert 1.000 medreg 1.13 [-0.36, 1.78] p90 6.89 n=40 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=0.627 | p over seeds (McN,Wil): 1,0.63; 1,0.32; 1,0.11 [0.9 ] model met 1.000±0.000 cert 1.000±0.000 medreg 0.97±0.40 | seed0: 0.50 [ 0.23, 1.31] p90 14.98 n=40 [0.9 ] retr_a met 1.000 cert 1.000 medreg 0.60 [-0.28, 2.28] p90 9.58 n=40 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=0.347 | p over seeds (McN,Wil): 1,0.35; 1,0.034; 1,0.1 [0.9 ] retr_b met 1.000 cert 1.000 medreg 0.91 [-0.01, 2.72] p90 9.58 n=40 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=0.745 | p over seeds (McN,Wil): 1,0.74; 1,0.062; 1,0.28 [0.9 ] retr_c met 1.000 cert 1.000 medreg 0.14 [-0.69, 1.60] p90 8.28 n=40 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=0.109 | p over seeds (McN,Wil): 1,0.11; 1,0.022; 1,0.031 [pooled] model met 1.000±0.000 cert 1.000±0.000 medreg 0.73±0.11 | seed0: 0.65 [ 0.22, 1.19] p90 14.78 n=120 [pooled] retr_a met 1.000 cert 1.000 medreg 0.87 [ 0.21, 1.71] p90 9.56 n=120 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=0.0556 | p over seeds (McN,Wil): 1,0.056; 1,0.015; 1,0.014 [pooled] retr_b met 1.000 cert 1.000 medreg 0.75 [ 0.21, 1.41] p90 9.56 n=120 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=0.0608 | p over seeds (McN,Wil): 1,0.061; 1,0.066; 1,0.014 [pooled] retr_c met 1.000 cert 1.000 medreg 0.86 [-0.10, 1.56] p90 8.26 n=120 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=0.0149 | p over seeds (McN,Wil): 1,0.015; 1,0.0092; 1,0.0024 --- MAIN DRAW seed 321: K=1 steer=none --- rows: rho | arm | spec-met | certified | regret% median [95% CI] p90 n (model = mean±sd over 3 seeds; CI/p90 from seed 0) [0.7 ] model met 0.908±0.012 cert 0.850±0.041 medreg 14.40±5.85 | seed0: 22.68 [ 8.02,36.94] p90 63.08 n=34 [0.7 ] retr_a met 0.700 cert 0.700 medreg 6.76 [ 2.03,12.26] p90 38.55 n=28 | vs model s0: McNemar 2-10 p=0.0386, Wilcoxon p=0.0395 | p over seeds (McN,Wil): 0.039,0.039; 0.057,0.037; 0.012,0.026 [0.7 ] retr_b met 0.675 cert 0.675 medreg 9.02 [ 2.90,13.68] p90 29.75 n=27 | vs model s0: McNemar 2-11 p=0.0225, Wilcoxon p=0.0384 | p over seeds (McN,Wil): 0.022,0.038; 0.022,0.052; 0.0063,0.038 [0.7 ] retr_c met 0.900 cert 0.900 medreg 8.51 [ 3.40,13.84] p90 31.05 n=36 | vs model s0: McNemar 3-3 p=1, Wilcoxon p=0.000906 | p over seeds (McN,Wil): 1,0.00091; 1,0.0013; 1,0.0052 [0.8 ] model met 0.883±0.051 cert 0.842±0.051 medreg 6.74±1.60 | seed0: 6.20 [ 3.96,15.82] p90 78.90 n=34 [0.8 ] retr_a met 0.775 cert 0.775 medreg 2.20 [ 0.87, 8.33] p90 24.33 n=31 | vs model s0: McNemar 4-8 p=0.388, Wilcoxon p=0.00247 | p over seeds (McN,Wil): 0.39,0.0025; 0.77,0.031; 0.065,0.06 [0.8 ] retr_b met 0.725 cert 0.725 medreg 9.86 [ 5.64,13.28] p90 29.73 n=29 | vs model s0: McNemar 4-10 p=0.18, Wilcoxon p=0.127 | p over seeds (McN,Wil): 0.18,0.13; 0.39,0.23; 0.012,0.69 [0.8 ] retr_c met 0.875 cert 0.875 medreg 5.78 [ 1.78,10.76] p90 27.94 n=35 | vs model s0: McNemar 3-3 p=1, Wilcoxon p=0.000398 | p over seeds (McN,Wil): 1,0.0004; 0.73,0.099; 0.38,0.074 [0.9 ] model met 0.892±0.031 cert 0.833±0.051 medreg 6.74±0.36 | seed0: 6.29 [ 4.54,11.19] p90 55.91 n=33 [0.9 ] retr_a met 0.650 cert 0.650 medreg 5.75 [ 4.02,17.38] p90 49.79 n=26 | vs model s0: McNemar 2-10 p=0.0386, Wilcoxon p=0.259 | p over seeds (McN,Wil): 0.039,0.26; 0.013,0.07; 0.0074,0.43 [0.9 ] retr_b met 0.700 cert 0.700 medreg 11.11 [ 4.49,17.55] p90 35.66 n=28 | vs model s0: McNemar 5-11 p=0.21, Wilcoxon p=0.427 | p over seeds (McN,Wil): 0.21,0.43; 0.057,0.14; 0.012,0.8 [0.9 ] retr_c met 0.825 cert 0.825 medreg 4.87 [ 1.64, 9.74] p90 31.94 n=33 | vs model s0: McNemar 4-5 p=1, Wilcoxon p=0.0564 | p over seeds (McN,Wil): 1,0.056; 0.55,0.015; 0.29,0.067 [pooled] model met 0.894±0.027 cert 0.842±0.048 medreg 8.03±0.52 | seed0: 8.62 [ 5.44,13.61] p90 64.20 n=101 [pooled] retr_a met 0.708 cert 0.708 medreg 6.09 [ 3.64, 8.44] p90 39.49 n=85 | vs model s0: McNemar 8-28 p=0.00119, Wilcoxon p=0.000397 | p over seeds (McN,Wil): 0.0012,0.0004; 0.0022,0.00066; 7.4e-06,0.004 [pooled] retr_b met 0.700 cert 0.700 medreg 9.73 [ 7.33,13.04] p90 32.05 n=84 | vs model s0: McNemar 11-32 p=0.00191, Wilcoxon p=0.00733 | p over seeds (McN,Wil): 0.0019,0.0073; 0.0011,0.0036; 7.7e-07,0.079 [pooled] retr_c met 0.867 cert 0.867 medreg 6.78 [ 3.92, 9.18] p90 30.74 n=104 | vs model s0: McNemar 10-11 p=1, Wilcoxon p=1.22e-06 | p over seeds (McN,Wil): 1,1.2e-06; 1,2.3e-05; 0.096,0.00013 --- MAIN DRAW seed 321: K=8 steer=S=50 --- rows: rho | arm | spec-met | certified | regret% median [95% CI] p90 n (model = mean±sd over 3 seeds; CI/p90 from seed 0) [0.7 ] model met 1.000±0.000 cert 1.000±0.000 medreg 0.17±0.05 | seed0: 0.23 [ 0.01, 0.75] p90 4.35 n=40 [0.7 ] retr_a met 1.000 cert 1.000 medreg -0.13 [-0.48, 0.15] p90 1.27 n=40 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=0.0725 | p over seeds (McN,Wil): 1,0.073; 1,3.5e-05; 1,0.0056 [0.7 ] retr_b met 1.000 cert 1.000 medreg -0.22 [-1.04, 0.14] p90 1.56 n=40 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=0.00726 | p over seeds (McN,Wil): 1,0.0073; 1,0.0018; 1,1.7e-06 [0.7 ] retr_c met 1.000 cert 1.000 medreg -0.04 [-0.19, 0.23] p90 1.20 n=40 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=0.077 | p over seeds (McN,Wil): 1,0.077; 1,1.7e-05; 1,0.0067 [0.8 ] model met 1.000±0.000 cert 1.000±0.000 medreg -0.03±0.01 | seed0: -0.02 [-0.06, 0.00] p90 11.62 n=40 [0.8 ] retr_a met 1.000 cert 1.000 medreg -0.15 [-0.38,-0.08] p90 0.11 n=40 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=1.81e-05 | p over seeds (McN,Wil): 1,1.8e-05; 1,5.1e-05; 1,0.00014 [0.8 ] retr_b met 1.000 cert 1.000 medreg -0.14 [-0.42,-0.07] p90 0.09 n=40 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=8.15e-06 | p over seeds (McN,Wil): 1,8.2e-06; 1,3.3e-05; 1,0.0001 [0.8 ] retr_c met 1.000 cert 1.000 medreg -0.20 [-0.45,-0.10] p90 2.02 n=40 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=0.000603 | p over seeds (McN,Wil): 1,0.0006; 1,0.0013; 1,0.00025 [0.9 ] model met 1.000±0.000 cert 1.000±0.000 medreg -0.03±0.01 | seed0: -0.02 [-0.09, 0.03] p90 9.95 n=40 [0.9 ] retr_a met 1.000 cert 1.000 medreg -0.11 [-0.26,-0.06] p90 0.86 n=40 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=0.00558 | p over seeds (McN,Wil): 1,0.0056; 1,0.0012; 1,0.015 [0.9 ] retr_b met 1.000 cert 1.000 medreg -0.13 [-0.27,-0.04] p90 5.73 n=40 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=0.00305 | p over seeds (McN,Wil): 1,0.0031; 1,0.0016; 1,0.017 [0.9 ] retr_c met 1.000 cert 1.000 medreg -0.10 [-0.25,-0.07] p90 0.86 n=40 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=0.00726 | p over seeds (McN,Wil): 1,0.0073; 1,0.0014; 1,0.028 [pooled] model met 1.000±0.000 cert 1.000±0.000 medreg -0.01±0.00 | seed0: -0.00 [-0.03, 0.12] p90 10.09 n=120 [pooled] retr_a met 1.000 cert 1.000 medreg -0.13 [-0.21,-0.09] p90 1.20 n=120 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=4.26e-07 | p over seeds (McN,Wil): 1,4.3e-07; 1,2.3e-10; 1,3.4e-07 [pooled] retr_b met 1.000 cert 1.000 medreg -0.15 [-0.28,-0.09] p90 1.56 n=120 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=1.91e-08 | p over seeds (McN,Wil): 1,1.9e-08; 1,1.1e-08; 1,7.5e-10 [pooled] retr_c met 1.000 cert 1.000 medreg -0.12 [-0.20,-0.08] p90 1.33 n=120 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=4.94e-06 | p over seeds (McN,Wil): 1,4.9e-06; 1,1.4e-09; 1,9.8e-07 --- MAIN DRAW seed 321: K=1 steer=S=50 --- rows: rho | arm | spec-met | certified | regret% median [95% CI] p90 n (model = mean±sd over 3 seeds; CI/p90 from seed 0) [0.7 ] model met 0.992±0.012 cert 0.942±0.042 medreg 5.05±3.48 | seed0: 9.82 [ 0.63,28.76] p90 51.33 n=36 [0.7 ] retr_a met 0.925 cert 0.900 medreg 0.75 [ 0.18, 1.64] p90 26.67 n=36 | vs model s0: McNemar 1-3 p=0.625, Wilcoxon p=0.0105 | p over seeds (McN,Wil): 0.62,0.011; 0.25,0.023; 0.25,0.0063 [0.7 ] retr_b met 0.875 cert 0.850 medreg 1.03 [ 0.37, 4.53] p90 21.92 n=34 | vs model s0: McNemar 1-5 p=0.219, Wilcoxon p=0.0149 | p over seeds (McN,Wil): 0.22,0.015; 0.062,0.029; 0.062,0.015 [0.7 ] retr_c met 1.000 cert 1.000 medreg 1.13 [ 0.36, 4.11] p90 21.78 n=40 | vs model s0: McNemar 1-0 p=1, Wilcoxon p=0.00185 | p over seeds (McN,Wil): 1,0.0018; 1,0.0051; 1,0.0019 [0.8 ] model met 0.992±0.012 cert 0.933±0.012 medreg 0.37±0.22 | seed0: 0.48 [ 0.27, 5.73] p90 55.20 n=37 [0.8 ] retr_a met 0.975 cert 0.975 medreg 0.03 [ 0.00, 0.25] p90 18.99 n=39 | vs model s0: McNemar 1-1 p=1, Wilcoxon p=0.000159 | p over seeds (McN,Wil): 1,0.00016; 1,0.0031; 1,0.17 [0.8 ] retr_b met 0.850 cert 0.850 medreg 0.43 [-0.04, 1.84] p90 15.47 n=34 | vs model s0: McNemar 1-6 p=0.125, Wilcoxon p=0.0175 | p over seeds (McN,Wil): 0.12,0.017; 0.031,0.058; 0.031,0.66 [0.8 ] retr_c met 1.000 cert 1.000 medreg 0.14 [ 0.02, 1.23] p90 22.30 n=40 | vs model s0: McNemar 1-0 p=1, Wilcoxon p=3.36e-06 | p over seeds (McN,Wil): 1,3.4e-06; 1,0.051; 1,0.14 [0.9 ] model met 0.992±0.012 cert 0.950±0.054 medreg 0.54±0.31 | seed0: 0.89 [ 0.20, 1.57] p90 36.20 n=40 [0.9 ] retr_a met 0.975 cert 0.975 medreg 0.11 [-0.00, 0.61] p90 25.81 n=39 | vs model s0: McNemar 0-1 p=1, Wilcoxon p=0.0372 | p over seeds (McN,Wil): 1,0.037; 1,0.0091; 1,0.47 [0.9 ] retr_b met 0.925 cert 0.925 medreg 0.18 [ 0.03, 1.11] p90 26.47 n=37 | vs model s0: McNemar 0-3 p=0.25, Wilcoxon p=0.0363 | p over seeds (McN,Wil): 0.25,0.036; 0.62,0.037; 0.25,0.61 [0.9 ] retr_c met 1.000 cert 1.000 medreg 0.11 [ 0.04, 0.53] p90 26.30 n=40 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=0.00336 | p over seeds (McN,Wil): 1,0.0034; 1,0.012; 1,0.38 [pooled] model met 0.992±0.007 cert 0.942±0.027 medreg 0.70±0.23 | seed0: 0.97 [ 0.43, 1.96] p90 51.49 n=113 [pooled] retr_a met 0.958 cert 0.950 medreg 0.18 [ 0.06, 0.46] p90 24.60 n=114 | vs model s0: McNemar 2-5 p=0.453, Wilcoxon p=6.12e-06 | p over seeds (McN,Wil): 0.45,6.1e-06; 0.22,1.3e-05; 0.062,0.003 [pooled] retr_b met 0.883 cert 0.875 medreg 0.49 [ 0.18, 1.11] p90 23.23 n=105 | vs model s0: McNemar 2-14 p=0.00418, Wilcoxon p=6.01e-05 | p over seeds (McN,Wil): 0.0042,6e-05; 0.00098,0.00026; 0.00012,0.037 [pooled] retr_c met 1.000 cert 1.000 medreg 0.35 [ 0.14, 0.82] p90 23.85 n=120 | vs model s0: McNemar 2-0 p=0.5, Wilcoxon p=2.01e-08 | p over seeds (McN,Wil): 0.5,2e-08; 1,3.2e-05; 1,0.0015 synthesis time per plant (ms; mean over rho; verification NOT included): model:s0 steer 258.21 model:s0 synth 89.52 model:s1 steer 270.89 model:s1 synth 91.89 model:s2 steer 267.04 model:s2 synth 89.57 retr_a steer 278.56 retr_a synth 0.08 retr_b steer 271.39 retr_b synth 0.09 retr_c steer 253.12 retr_c synth 0.14 oracle found per rho (draw 777): [40, 40, 40] --- SECOND DRAW seed 777: K=8 steer=none --- rows: rho | arm | spec-met | certified | regret% median [95% CI] p90 n (model = mean±sd over 3 seeds; CI/p90 from seed 0) [0.7 ] model met 1.000±0.000 cert 1.000±0.000 medreg 1.13±0.34 | seed0: 1.23 [-0.22, 3.18] p90 11.81 n=40 [0.7 ] retr_a met 1.000 cert 1.000 medreg 0.94 [-0.93, 3.71] p90 12.46 n=40 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=0.952 | p over seeds (McN,Wil): 1,0.95; 1,0.045; 1,0.79 [0.7 ] retr_b met 1.000 cert 1.000 medreg 1.10 [-0.21, 2.94] p90 9.35 n=40 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=0.32 | p over seeds (McN,Wil): 1,0.32; 1,0.51; 1,0.25 [0.7 ] retr_c met 1.000 cert 1.000 medreg 0.50 [-0.93, 3.02] p90 11.93 n=40 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=0.847 | p over seeds (McN,Wil): 1,0.85; 1,0.12; 1,0.51 [0.8 ] model met 1.000±0.000 cert 1.000±0.000 medreg 0.97±0.29 | seed0: 0.62 [ 0.01, 1.74] p90 15.47 n=40 [0.8 ] retr_a met 1.000 cert 1.000 medreg 0.67 [-0.05, 2.42] p90 5.18 n=40 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=0.347 | p over seeds (McN,Wil): 1,0.35; 1,0.18; 1,0.024 [0.8 ] retr_b met 1.000 cert 1.000 medreg 1.31 [ 0.23, 2.61] p90 5.59 n=40 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=0.361 | p over seeds (McN,Wil): 1,0.36; 1,0.25; 1,0.15 [0.8 ] retr_c met 1.000 cert 1.000 medreg 0.44 [-0.16, 1.69] p90 5.43 n=40 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=0.277 | p over seeds (McN,Wil): 1,0.28; 1,0.14; 1,0.0094 [0.9 ] model met 1.000±0.000 cert 1.000±0.000 medreg 1.05±0.05 | seed0: 1.08 [ 0.46, 2.54] p90 8.63 n=40 [0.9 ] retr_a met 1.000 cert 1.000 medreg 0.64 [-0.44, 1.57] p90 7.26 n=40 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=0.125 | p over seeds (McN,Wil): 1,0.12; 1,0.094; 1,0.71 [0.9 ] retr_b met 1.000 cert 1.000 medreg 0.65 [-0.34, 1.66] p90 7.14 n=40 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=0.132 | p over seeds (McN,Wil): 1,0.13; 1,0.16; 1,0.53 [0.9 ] retr_c met 0.975 cert 0.975 medreg 0.50 [-0.35, 1.24] p90 5.51 n=39 | vs model s0: McNemar 0-1 p=1, Wilcoxon p=0.124 | p over seeds (McN,Wil): 1,0.12; 1,0.1; 1,0.69 [pooled] model met 1.000±0.000 cert 1.000±0.000 medreg 0.96±0.11 | seed0: 0.92 [ 0.43, 1.59] p90 11.90 n=120 [pooled] retr_a met 1.000 cert 1.000 medreg 0.80 [ 0.06, 1.32] p90 9.77 n=120 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=0.155 | p over seeds (McN,Wil): 1,0.16; 1,0.61; 1,0.097 [pooled] retr_b met 1.000 cert 1.000 medreg 0.99 [ 0.14, 1.57] p90 8.49 n=120 | vs model s0: McNemar 0-0 p=1, Wilcoxon p=0.0619 | p over seeds (McN,Wil): 1,0.062; 1,0.29; 1,0.062 [pooled] retr_c met 0.992 cert 0.992 medreg 0.50 [ 0.01, 1.01] p90 9.27 n=119 | vs model s0: McNemar 0-1 p=1, Wilcoxon p=0.102 | p over seeds (McN,Wil): 1,0.1; 1,0.29; 1,0.037 synthesis time per plant (ms; mean over rho; verification NOT included): model:s0 synth 91.34 model:s1 synth 90.86 model:s2 synth 91.90 retr_a synth 0.08 retr_b synth 0.11 retr_c synth 0.11 saved