diff --git a/docs/icml_r3_x29.md b/docs/icml_r3_x29.md new file mode 100644 index 0000000000000000000000000000000000000000..38aef902d42d6b86a9ada15f231682936278a1cb --- /dev/null +++ b/docs/icml_r3_x29.md @@ -0,0 +1,198 @@ +--- +title: C+phi next to C-only with the same baselines and KPIs (X29). SISO, the two generators tie at 16 samples on the common J* and both have lower median regret than kNN, the regression twin and the flat references. MIMO spline setting (200 fresh plants per m), the repaired C+phi generator has the lowest median regret of the generators and baselines at 16 samples at both m, and C-only certifies more at 1 sample. Actuator setting, at the per-plant optimum C+phi equals C-only (median gain 0.00% at m = 3, 4, 5) +date: 2026-11-17 +status: SISO (with CPU), MIMO spline setting (with CPU) and actuator step 3A complete; actuator step 3B (C+phi generators on X27's banks) not run, pending Matteo's decision +claim: X29 (Matteo 2026-11-16, via dc_presentation and in the move-HPC session): "I need to have the final baseline comparison also for the spline methods". C+phi (the model generates the linear part and the spline phi, X28) gets the same baselines and KPIs as C-only (phi fixed: SISO sat_1, MIMO identity) in every setting of the deck v10 slides. +maps_to: deck v10 slides [35] [36] [37] [38] [73] (SISO); the three new MIMO spline-setting slides and [73]; [50] [51] [52] [84] [73] (actuator); summaries [54] [72] [77]. No paper edit until Matteo agrees the claim. +scripts: nonlinear/experiments/x29_siso.py (SISO kNN, twins, optimizer from the best sample, timing, report), nonlinear/mimo_unstable/x29_t2.py (MIMO spline setting on T2: kNN, twins, 48-start solver, Adam references, timing, report), nonlinear/mimo_unstable/x29_act.py (actuator 3A: composed-sector certificate, simulated X27 cost, optimizer, new directions, report, X27 rows and re-score) +artifacts: results/icml_r3/X29/{PREREG.md, PREREG_siso.md, PREREG_t2.md}; results/icml_r3/X29/siso/{report.txt, eqcheck.txt, eval/, refine/, timing/, timing_batched.json}; results/icml_r3/X29/t2/{report.txt, numbers.json, cpu_report.txt, timing_m2.json, timing_m3.json, knn_m*_{a,b}.npz, twin_*.npz, solver_m*.npz, ard_m2.npz}; results/icml_r3/X29/act/{selfcheck_*.json, report_3a_heldout_m*.txt, heldout_m*/, x27rows_*.npy, x27rescore_*.txt, x27rescore_*.json}; models/x29_twin_clS{,_s1,_s2}/, models/x29t/; HF matCercola18/DiffusionControl commits 8f92ad1d (SISO), d7d0258 (MIMO spline setting), 09f35d5 (actuator 3A) +--- + +# C+phi next to C-only with the same baselines and KPIs (X29) + +## TL;DR +- **Question:** The deck compares C-only (phi fixed; the model generates the linear part) with kNN, regression twins, per-plant optimizers and classical references. Matteo asked for the same comparison for C+phi (the model also generates the spline phi, X28) in every setting, on one regret reference per setting. +- **SISO (199 test plants):** at 16 samples the C+phi generator certifies 95.6% of plants with median regret 6.59%, and C-only 98.0% with 6.74% (3-seed means). Both have lower regret than their kNN (11.3%, 10.2%), their regression twins (31.8%, 20.1%), the tuned LQG or static gain (34.05%) and the best of 16 HIFOO starts (50.75%). At 1 sample C+phi certifies 50.6% of plants against 64.0%. The joint optimizer reaches the C+phi generator's regret with 2 starts; the F-only optimizer needs 8 to reach C-only's. On one CPU thread the C+phi generator costs 29.1 s per plant at 16 samples against 11.5 s (same sampling time, slower scoring), and the variant's own optimizer at the start count that reaches the generator's regret costs 106 times the C+phi generator's CPU and 138 times the C-only generator's (October: 140 times). +- **MIMO spline setting (200 fresh plants per m):** at 16 samples the repaired C+phi generator has median regret 6.56% at m = 3 and 3.59% at m = 2, against 10.22% and 6.42% for C-only, with certified shares within 0.5 points. Its kNN and twin also have lower regret than C-only's. The 48-start solver has 11.60% and 12.33%. At 1 sample C-only certifies more plants (95.7% against 79.7% at m = 3). Each generator costs about 3 s per plant on one CPU thread and about 0.05 s per plant batched on a GPU; the per-plant Adam optimizer costs about 4,200 to 5,100 s and 34 to 41 s. +- **Actuator setting (X27's 120 test plants per m):** at each plant's optimum C+phi costs the same as C-only (median gain 0.00% at m = 3, 4 and 5), and the best certified spline is linear on most plants. So a C+phi generator can at best tie here, and step 3B (C+phi generators on X27's banks, 2 to 3 GPU-days) waits for Matteo. X27's C-only pipeline, re-run on its stored candidates, reproduces every published number; on the common J*_A the regret of its filtered arms at 16 samples rises by 0.5 to 1.2 points in X27's convention (median over certified plants). +- **So what:** C+phi changes the comparison only in the MIMO spline setting, where it has lower regret than C-only for every method family at 16 samples. On SISO it ties, and in the actuator setting it has nothing to gain at the optimum. With 1 sample, C-only certifies more plants in SISO and in the MIMO spline setting. + +## 1. Problem / Goal +- **C-only:** SISO u = -sat_1(clip(F y, +-5)) with a generated dynamic filter F (X21); MIMO a generated gain K with phi = identity, in the X28-M spline setting (u = -K y) and in X27's actuator setting (u = -Phi(K y), Phi unknown in a sector). +- **C+phi:** the same model also generates phi. SISO: an 11-knot spline with |phi| <= 1, phi(0) = 0 (X28 S3). MIMO: per channel an odd piecewise-linear spline with knots at |x| = 1, 3, 5 and knot ratios in [0.1, 10] (the so3 class, X28-M). +- **Goal:** every deck KPI (certified share and median regret vs budget b, CPU vs regret, compute ratio, generator minus kNN at b = 1) for both variants, on one reference J* per setting, with the same baselines. Nothing published is replaced; C-only numbers are re-scored on the common J*. +- **No new verdict rule** in SISO and the MIMO spline setting: the registered X28 verdicts stand. The actuator setting had no C+phi yet; its first step (3A) measures whether C+phi can gain at all. + +## 2. Method +Pre-registration: `results/icml_r3/X29/PREREG.md` (2026-11-16 18:30 UTC, before any X29 code ran) and its addenda in `PREREG.md`, `PREREG_siso.md` and `PREREG_t2.md`, each filed before the number it affects. + +- **Regret** at budget b: (J_b - J*) / J*, with J_b the cheapest certified of the first b candidates. A plant with no certified candidate counts 1e3. A cell where fewer than half the plants certify has no finite median ("n/a"). Median with a bootstrap 95% CI over plants (10,000 resamples). Seeded methods: 3-seed mean and range, plus seed 0. +- **J\* per setting:** SISO min(J_Fonly, X28 test joint labels) as X28 S4; MIMO spline setting min of the T2 id and so3 labels (gauges c = 1, 2, 5); actuator min(J_ref, J_id, J_so3) from step 3A. +- **SISO arms** (199 X21 test plants, clip 1.5, t-repair on every arm): + - generators: clL (C-only) and clS (C+phi), seeds 0 to 2, stored X28 evaluations; 64 samples for seed 0; + - kNN: X22's rule on the X21 F-only bank (C-only) and on the c = 1 joint rows of the 1,971 training plants (C+phi), ARD metric of X21; + - regression twins: X23's twins of clL (stored X21 outputs, see deviations) and new twins of clS (X23 recipe, 60,000 steps, best validation checkpoint), seeds 0 to 2; + - per-plant optimizers: F-only, best of the first k X21 labels (C-only's own); joint, best of the first k joint rows (C+phi's own); k = 1, 2, 4, 8, 16; + - optimizer from the generator's best b = 16 sample: 1 F-only start (X24 refine) for C-only, 1 joint start (S2 warm arm) for C+phi, seed 0; + - flat references: tuned saturated LQG or static gain (J_lin), best of 16 HIFOO starts. +- **MIMO spline setting** (T2: 200 fresh plants per m, m = 2, 3, as the X28 addendum of 2026-11-15): + - generators: C-only (a) and C+phi (b), seeds 0 to 2, stored; C+phi repaired (repair R: rejected samples' knots flattened toward r(1) until the circle LMI certifies) is primary, as drawn is secondary; + - kNN: label (a) or (b) of the 16 nearest S2-M bank plants, ARD metric (m = 3 X10's, m = 2 fitted on the m = 2 bank before any kNN number); + - regression twins: `mh_train` arm "reg" on the S3-M datasets (a) and (b), seeds 0 to 2; + - flat references: the 48-start solver's best gain (X27 oracle, Lyapunov test, X28 cost) and the per-plant Adam optimizer of each variant (C-only: id start; C+phi: J*_T2 itself, regret 0 by construction). +- **Actuator setting, step 3A** (X27's 120 test plants per m, m = 3, 4, 5): + - controller u = -Phi(phi(K y)), with Phi the unknown actuator (each channel in the sector [0.4, 2.2], X27) and phi in the so3 class; C-only is phi = identity; + - certificate: circle LMI on the composed sector [0.4 alpha_i, 2.2 beta_i], alpha_i and beta_i the min and max knot ratio of channel i. It is sound because each channel's composition Phi_i(psi_i(.)) is memoryless and lies in that sector; at identity knots it is X27's test; + - cost: X27's quadratic cost (mean over the 2m unit state directions of the integral of |x|^2 + 0.1 |u|^2, Phi = identity) by simulation, RK4 at dt 0.01, T = 20 s; + - label optimizer: X28-M's procedure from X27's stored best gain K_ref; arm id (knots frozen) and arm so3 at gauges c = 1, 2, 5; K lr and knot lr 0.02; 400 steps; the cheapest certified snapshot; + - reported: d = (J_id - J_so3) / J_so3; (J_ref - J_id) / J_id (extra optimization alone); the composed-sector ratio of the best so3 controller; d on 64 new random unit state directions per plant; + - X27's stored C-only candidates re-run through X27's pipeline per plant and re-scored on J*_A. +- **CPU:** one timing job per setting on a node with nothing else of this project running. "One" = one plant on one CPU thread, median over 10 timing plants (SISO: 6 such tasks at a time on 8 cores; MIMO: one at a time). + - MIMO (node move-hpc-08-gpu): "batched" = all 200 plants in one call, with sampling, rollouts and Adam on the node's NVIDIA L40S GPU and certificates on 6 CPU workers, wall time / 200. + - SISO (node move-hpc-06-gpu, also an L40S): "batched" = generator and twin sampling (199 plants x 16) and kNN retrieval in one call, wall time / 199, without scoring (PREREG section 2). + - Per-point CPU follows X24's formulas; the joint optimizer at k starts is charged k HIFOO starts + the F-only optimizer at k + the joint optimizer at k. +- **Self-checks** (two failed and were handled by addenda before the numbers they affect; see deviations): + - SISO: C-only kNN reproduces X21's stored kNN (K16 +0.16 points per candidate, +0.50 plants; K64 +0.07, +0.00); batched optimizers equal the single-plant functions (relative J difference 0 at 25 and 100 steps); + - MIMO spline setting: 5 bank plants per m retrieve themselves first; the solver's cost equals the stored label snapshot (maximum relative difference 0); + - actuator: the composed-sector certificate at identity knots agrees with `family_sofm.verify` on 200 gains per m (0 disagreements at m = 3, 4, 5); the simulated cost equals tr(P)/(2m) on the 120 stored gains per m (median relative difference 1.3e-5 to 2.2e-5, maximum 2.6e-4 to 1.4e-3). + +## 3. Results + +### 3.1 SISO, 199 test plants +Source: `results/icml_r3/X29/siso/report.txt`. Certified % / median regret %; generator and twin: 3-seed mean [range]; kNN: one run; b = 64: seed 0. + +| method | b = 1 | b = 4 | b = 16 | b = 64 | +|---|---|---|---|---| +| C-only generator | 64.0 / 49.0 | 92.0 / 12.7 | 98.0 [97.5, 98.5] / 6.74 [6.62, 6.81] | 98.5 / 4.07 | +| C+phi generator | 50.6 / n/a on 2 of 3 seeds | 84.9 / 17.1 | 95.6 [95.0, 96.5] / 6.59 [6.30, 7.14] | 99.0 / 2.96 | +| C-only kNN | 57.3 / 81.3 | 86.9 / 19.4 | 96.5 / 10.19 | 98.5 / 6.49 | +| C+phi kNN | 46.2 / n/a | 77.9 / 22.7 | 93.5 / 11.32 | 98.0 / 6.26 | +| C-only twin | 68.5 / 48.1 | 77.2 / 30.3 | 85.6 [85.4, 85.9] / 20.1 [19.9, 20.3] | | +| C+phi twin | 42.2 / n/a | 61.8 / 66.1 | 71.0 [68.8, 72.9] / 31.8 [30.0, 32.9] | | +| LQG or static gain | | | 100 / 34.05 | | +| HIFOO, best of 16 | | | 100 / 50.75 | | + +Per-plant optimizers, median regret % at k = 1, 2, 4, 8, 16 starts (certified 100%): +- F-only (C-only's own): 35.91, 13.55, 8.11, 4.19, 3.12. +- Joint (C+phi's own): 9.13, 4.39, 0.92, 0.00, 0.00. The joint labels define J*, so 0 at 8 and 16 starts is by construction. +- Generator at 16 plus 1 optimizer start (seed 0): C-only 98.5% / 2.60%, C+phi 95.0% / 0.01%. Only plants with a certified b = 16 sample get a start (196 C-only, 189 C+phi); the rest count as uncertified. + +Compute ratio inputs ([38], seed 0): the C-only generator's 6.79% is first reached by the F-only optimizer at k = 8 (4.19%; k = 4 gives 8.11%). The C+phi generator's 7.14% is first reached by the joint optimizer at k = 2 (4.39%; k = 1 gives 9.13%). The paired verdict at b = 16 stays X28 S4's: no measurable difference on 3 of 3 seed pairs (gain -0.32 to +0.19 points). + +[73], certified at b = 1, generator minus its own variant's kNN (points, plant-paired, 95% CI), seeds 0 / 1 / 2: +- C-only: +8.0 [-0.5, +16.6] / +8.0 [-0.5, +16.6] / +4.0 [-4.0, +12.1]. +- C+phi: +3.0 [-6.0, +12.1] / +6.5 [-3.0, +16.1] / +3.5 [-5.5, +12.6]. +- All six intervals include 0. + +### 3.2 MIMO spline setting, 200 fresh plants per m +Source: `results/icml_r3/X29/t2/report.txt`. Certified % / median regret %, 3-seed means (kNN one run). + +| method | m = 3, b = 1 | m = 3, b = 16 | m = 2, b = 1 | m = 2, b = 16 | +|---|---|---|---|---| +| C+phi generator, repaired | 79.7 / 17.73 | 99.8 / 6.56 | 90.5 / 10.17 | 99.7 / 3.59 | +| C+phi generator, as drawn | 61.5 / 22.85 | 95.3 / 6.60 | 78.0 / 10.68 | 97.2 / 3.65 | +| C-only generator | 95.7 / 16.32 | 99.5 / 10.22 | 98.5 / 8.96 | 99.8 / 6.42 | +| C+phi kNN, repaired | 90.5 / 61.40 | 100 / 15.88 | 88.0 / 34.85 | 100 / 8.89 | +| C+phi kNN, as drawn | 48.0 / n/a | 99.5 / 17.55 | 60.0 / 76.27 | 100 / 9.83 | +| C-only kNN | 80.0 / 70.87 | 100 / 23.77 | 89.5 / 42.67 | 100 / 13.56 | +| C+phi twin, repaired | 76.3 / 22.16 | 95.0 / 10.84 | 88.3 / 12.14 | 98.0 / 6.23 | +| C+phi twin, as drawn | 60.3 / 28.50 | 83.2 / 11.26 | 77.7 / 12.74 | 90.8 / 6.31 | +| C-only twin | 94.2 / 18.21 | 98.7 / 13.81 | 98.7 / 9.22 | 99.7 / 7.71 | +| 48-start solver | | 100 / 11.60 | | 100 / 12.33 | +| Adam, C-only (id start) | | 100 / 4.33 | | 100 / 5.07 | +| Adam, C+phi (id + so3 c = 1, 2, 5) | | 100 / 0 (defines J*) | | 100 / 0 (defines J*) | + +- At b = 4 (same file): repaired C+phi generator 93.8 / 9.70 (m = 3) and 97.8 / 5.47 (m = 2); C-only generator 99.2 / 12.73 and 99.3 / 7.30. +- [73], certified at b = 1, generator minus its own kNN (points, 95% CI), seeds 0 / 1 / 2: + - m = 3: C+phi repaired -10.0 [-17.0, -3.0] / -12.5 [-19.5, -5.5] / -10.0 [-16.5, -3.5]; as drawn +14.0 / +13.0 / +13.5 (CIs above 0); C-only +15.5 / +17.5 / +14.0 (CIs above 0). + - m = 2: C+phi repaired +3.0 [-3.0, +9.0] / +2.0 [-4.0, +8.0] / +2.5 [-3.0, +8.0]; as drawn +18.0 / +15.5 / +20.5 (CIs above 0); C-only +9.0 on all seeds (CIs above 0). + - With repair, the C+phi kNN certifies more plants at b = 1 than the C+phi generator at m = 3 (90.5% against 79.7%). + +### 3.3 Actuator setting, step 3A (per-plant optimum), 120 test plants per m +Source: `results/icml_r3/X29/act/report_3a_heldout_m{3,4,5}.txt`. All id and so3 starts certified on 118 to 120 of 120 plants. + +| | m = 3 | m = 4 | m = 5 | +|---|---|---|---| +| d = (J_id - J_so3) / J_so3, median [CI] | 0.00% [0.00, 0.00] | 0.00% [0.00, 0.00] | 0.00% [0.00, 0.00] | +| plants with d >= 2% | 16 of 120 | 9 of 120 | 13 of 120 | +| mean d | 0.68% | 0.34% | 0.44% | +| extra optimization alone, (J_ref - J_id) / J_id, median | 0.00% | 0.00% | 0.00% | +| composed-sector ratio of the best so3 controller, median (90th pct); 5.5 = linear | 5.50 (15.97) | 5.50 (11.37) | 5.50 (12.18) | +| d on 64 new directions per plant, median of per-plant medians | +0.00% | +0.00% | +0.00% | + +- The best so3 controller comes from the id start on 69, 78 and 76 of 120 plants: the spline starts found nothing cheaper there. +- The written expectation (PREREG section 4) was a small d: the composed sector is 5.5 beta/alpha wide, so a nonlinear spline needs a wider robust sector than a linear gain, and the quadratic cost does not reward an amplitude-dependent gain. + +X27's C-only pipeline re-scored on J*_A (`results/icml_r3/X29/act/x27rescore_*.txt`). Re-running it on the stored candidates reproduces every published certified share and regret. Certified shares are unchanged. X27 publishes the median over certified plants (seeds pooled); in that convention, median regret %, published (vs J_ref) and on J*_A: + +| X27 arm (keep the cheapest certified) | m = 3 | m = 4 | m = 5 (16k bank) | +|---|---|---|---| +| diffusion, filter, b = 16 | 1.50 -> 2.18 | 3.04 -> 3.73 | 3.38 -> 3.92 | +| diffusion, filter + 10 solver iterations | 1.50 -> 2.21 | 3.24 -> 3.85 | 3.44 -> 4.00 | +| twin, filter, b = 16 | 2.50 -> 3.39 | 3.46 -> 4.00 | 3.57 -> 4.59 | +| kNN, filter + 10 solver iterations | 7.34 -> 8.58 | 9.03 -> 9.68 | 10.34 -> 10.97 | + +Stopping at the first certified candidate instead, the diffusion arm with iterations has 4.01 -> 5.15, 5.71 -> 6.40 and 5.65 -> 6.75. + +In the X29 convention (all plants, uncertified = 1e3, median per seed, 3-seed mean), on J*_A, cheapest certified at b = 16, certified % / median regret %: + +| X27 arm | m = 3 | m = 4 | m = 5 | +|---|---|---|---| +| diffusion, filter + 10 solver iterations | 99.7 / 2.22 | 97.8 / 3.96 | 98.1 / 4.04 | +| diffusion, filter | 98.6 / 2.24 | 91.9 / 4.05 | 90.8 / 4.30 | +| twin, filter | 73.1 / 5.25 | 52.2 / 12.06 | 55.6 / 9.61 | +| kNN, filter + 10 solver iterations (one run) | 93.3 / 8.84 | 93.3 / 10.01 | 92.5 / 11.51 | + +The twin's low certified share counts against it here, unlike in the published convention. + +### 3.4 CPU +MIMO spline setting (`results/icml_r3/X29/t2/cpu_report.txt`; seconds per plant, one | batched; median regret on J*_T2): + +| method | m = 3 | m = 2 | +|---|---|---| +| C+phi generator, b = 16 | 2.96 \| 0.055; 6.56% | 2.85 \| 0.054; 3.59% | +| C-only generator, b = 16 | 2.88 \| 0.050; 10.22% | 2.79 \| 0.049; 6.42% | +| C+phi kNN, b = 16 | 1.34 \| 0.054; 15.88% | 1.27 \| 0.053; 8.89% | +| C-only kNN, b = 16 | 1.25 \| 0.042; 23.77% | 1.18 \| 0.043; 13.56% | +| C+phi twin, b = 16 | 1.39 \| 0.050; 10.84% | 1.28 \| 0.051; 6.23% | +| C-only twin, b = 16 | 1.35 \| 0.045; 13.81% | 1.24 \| 0.044; 7.71% | +| 48-start solver, all starts | 6.01 \| not batched; 11.60% | 7.38 \| not batched; 12.33% | +| Adam, C+phi (4 starts, 400 steps + certify) | 5,131 \| 41.4; 0% | 5,102 \| 41.4; 0% | +| Adam, C-only (id start) | 4,177 \| 34.6; 4.33% | 4,170 \| 34.1; 5.07% | + +At b = 1 a generator costs 1/16 of its b = 16 cost (X24's convention): 0.18 to 0.19 s one at a time. + +SISO (`results/icml_r3/X29/siso/report.txt`, CPU section; seconds per plant on one CPU thread, median over the 10 timing plants; median regret on J*, seed 0): + +| point | CPU | median regret | +|---|---|---| +| C-only generator, b = 1 / b = 16 | 0.7 s / 11.5 s | 54.90% / 6.79% | +| C+phi generator, b = 1 / b = 16 | 1.8 s / 29.1 s | n/a / 7.14% | +| F-only optimizer, 1 / 2 / 4 / 8 / 16 starts | 1,555 / 1,544 / 1,522 / 1,582 / 1,702 s | 35.91 / 13.55 / 8.11 / 4.19 / 3.12% | +| joint optimizer, 1 / 2 / 4 / 8 / 16 starts | 3,092 / 3,084 / 3,068 / 3,196 / 3,451 s | 9.13 / 4.39 / 0.92 / 0.00 / 0.00% | +| C-only generator 16 + 1 F-only start | 1,565 s | 2.60% | +| C+phi generator 16 + 1 joint start | 1,566 s | 0.01% | +| HIFOO, best of 16 | 15.3 s | 50.75% | +| C-only kNN / C+phi kNN, b = 16 | 9.5 s / 7.6 s | 10.19% / 11.32% | +| C-only twin / C+phi twin, b = 16 | 1.9 s / 17.2 s | 20.27% / 32.47% | + +- **Compute ratio ([38]):** C-only, the F-only optimizer at 8 starts (1,582 s) against the generator's 11.5 s: 138 times. C+phi, the joint optimizer at 2 starts (3,084 s) against the generator's 29.1 s: 106 times. +- **Why the C+phi ratio is only somewhat smaller:** the joint optimizer needs 2 starts against 8, but the optimizer's cost is nearly flat in the number of starts (the k starts run in one vectorized call, X24's convention; the F-only optimizer at 1 start ranges from 1,503 to 1,610 s over the timing plants, wider than the differences between start counts). The joint optimizer is also charged the F-only optimizer it starts from, which doubles its cost. And the C+phi generator costs 2.5 times C-only's: sampling takes the same time (median 8.7 s for 16 samples), but scoring C+phi candidates takes a median 20.4 s against 2.8 s, from 10 to 110 s in total over the timing plants. +- **Batched on the GPU** (sampling only, 199 plants in one call, `timing_batched.json`): generator 0.019 s per plant for both variants, twin 0.003 s, kNN retrieval 0.013 s (C-only) and 0.005 s (C+phi). +- The optimizer tasks ran 6 at a time on 8 cores (load about 6); the MIMO timings ran one plant at a time (load 0.7 to 1.0). Ratios are within one setting, so this does not change them, but absolute seconds across the two settings are not measured under the same load. + +## 4. Conclusion +- **SISO:** C+phi and C-only generators tie at 16 samples on the common J*, as X28 S4 found, and both have lower median regret than kNN, the regression twins and the flat references. C+phi's own optimizer is stronger (2 joint starts reach the C+phi generator's regret; the F-only optimizer needs 8 to reach C-only's), but each optimizer costs about the same at any start count, so the compute ratio moves only from 138 times (C-only) to 106 times (C+phi). At 1 and 4 samples C+phi certifies fewer plants. +- **MIMO spline setting:** C+phi has lower median regret than C-only for each method family at 16 samples (difference of median regrets at m = 3 and m = 2: generator 3.7 and 2.8 points, kNN 7.9 and 4.7, twin 3.0 and 1.5), at equal certified share with repair. C-only certifies more at 1 sample. The C+phi generator at 16 samples has lower median regret than C-only's per-plant Adam optimizer at m = 2 (3.59% against 5.07%), not at m = 3 (6.56% against 4.33%), at about 1/1,500 of its CPU per plant on one thread. +- **Actuator setting:** generating phi gains nothing at the per-plant optimum, so the actuator slides can state "C+phi = C-only here" with the 3A numbers. Step 3B is not run unless Matteo asks for it. + +**Deviations and caveats** +- SISO C-only twin rows are X21's stored outputs re-scored on J*. The re-sampled seed 0 missed its 1-point self-check on the certified share per candidate (+1.57) because the MC-dropout draws differ across machines; this was registered before any twin regret (`PREREG_siso.md`, 19:05 UTC). The re-sampled rows agree within 1 point at b = 16 (85.76% / 20.73%). +- The C+phi SISO twins reached their best validation loss early (step 4,000 of 60,000), so part of their gap to the generator may come from the training run. +- The actuator cost first used the trapezoid rule, which failed the tr(P) self-check at every horizon (median 0.25%); it was replaced by RK4 on an extra cost state before any 3A number (`PREREG.md` addendum 18:20 UTC). +- The joint optimizer and the C+phi Adam optimizer define J* in their settings, so their regret falls to 0 by construction. +- Regrets here are on each setting's common J* and are higher than earlier C-only numbers on J_Fonly (SISO) or J_ref (actuator); the two scales are not mixed. +- The MIMO spline J*_T2 uses id and so3 labels only, so T2 regrets are not on the scale of the held-out X28 regrets. +- The SISO and MIMO timings ran on two different nodes (move-hpc-06-gpu and move-hpc-08-gpu, 8 cores and an NVIDIA L40S each), each with nothing else of this project running. Ratios are computed within one setting's timing job. + +**Sources:** the PREREG and addenda in `results/icml_r3/X29/`; the report files named in each section; HF commits 8f92ad1d (SISO), d7d0258 (MIMO spline setting) and 09f35d5 (actuator 3A). diff --git a/results/icml_r3/X29/act/x27rescore_d3fm3n8000.json b/results/icml_r3/X29/act/x27rescore_d3fm3n8000.json index 77bb0f8b82440432cd7b451f5d9e417a7b0417d2..e892d0c26d7385c8a63fb3920171347d1308942a 100644 --- a/results/icml_r3/X29/act/x27rescore_d3fm3n8000.json +++ b/results/icml_r3/X29/act/x27rescore_d3fm3n8000.json @@ -9,7 +9,12 @@ "regB_ref": 0.035166553853986704, "regB_star": 0.04939973422469457, "regA_ref": 0.035166553853986704, - "regA_star": 0.04939973422469457 + "regA_star": 0.04939973422469457, + "reg29_star_per_seed": [ + 0.1173585852888046, + 0.6048869266055182, + 1000.0 + ] }, "diff raw_b4": { "rate": 0.7611111111111111, @@ -21,7 +26,12 @@ "regB_ref": 0.026566873792452816, "regB_star": 0.036538855499143374, "regA_ref": 0.03912745224114178, - "regA_star": 0.05271375933165312 + "regA_star": 0.05271375933165312, + "reg29_star_per_seed": [ + 0.054677934415332974, + 0.05112708412480571, + 0.0515105084462818 + ] }, "diff raw_b16": { "rate": 0.9444444444444443, @@ -33,7 +43,12 @@ "regB_ref": 0.017749766148115964, "regB_star": 0.02536120788249141, "regA_ref": 0.03975266005687195, - "regA_star": 0.051211998589972385 + "regA_star": 0.051211998589972385, + "reg29_star_per_seed": [ + 0.025756009753485576, + 0.029513557045964256, + 0.02766465097867299 + ] }, "diff filt_b1": { "rate": 0.6861111111111112, @@ -45,7 +60,12 @@ "regB_ref": 0.03864968435767513, "regB_star": 0.051490162113829285, "regA_ref": 0.03864968435767513, - "regA_star": 0.051490162113829285 + "regA_star": 0.051490162113829285, + "reg29_star_per_seed": [ + 0.0763562167545252, + 0.07432971205930794, + 0.10765837454236571 + ] }, "diff filt_b4": { "rate": 0.9277777777777777, @@ -57,7 +77,12 @@ "regB_ref": 0.024622161334723724, "regB_star": 0.03283620184325242, "regA_ref": 0.03892824451900456, - "regA_star": 0.05086767155048544 + "regA_star": 0.05086767155048544, + "reg29_star_per_seed": [ + 0.03562885445803954, + 0.03860264335993191, + 0.032221163711480205 + ] }, "diff filt_b16": { "rate": 0.9861111111111112, @@ -69,7 +94,12 @@ "regB_ref": 0.014977849993612624, "regB_star": 0.0218213442998485, "regA_ref": 0.03976742768706387, - "regA_star": 0.050933835066115485 + "regA_star": 0.050933835066115485, + "reg29_star_per_seed": [ + 0.0235246180444032, + 0.023310251680270566, + 0.020264949687200495 + ] }, "diff ref_b16_n3": { "rate": 0.9944444444444445, @@ -81,7 +111,12 @@ "regB_ref": 0.015012072869242443, "regB_star": 0.021944205370784453, "regA_ref": 0.03991946776173949, - "regA_star": 0.051211998589972385 + "regA_star": 0.051211998589972385, + "reg29_star_per_seed": [ + 0.0235246180444032, + 0.023310251680270566, + 0.019837172273985404 + ] }, "diff ref_b16_n10": { "rate": 0.9972222222222222, @@ -93,7 +128,12 @@ "regB_ref": 0.015046295744872262, "regB_star": 0.022067066441720407, "regA_ref": 0.04007150783641511, - "regA_star": 0.051490162113829285 + "regA_star": 0.051490162113829285, + "reg29_star_per_seed": [ + 0.0235246180444032, + 0.023310251680270566, + 0.019837172273985404 + ] }, "twin raw_b1": { "rate": 0.4916666666666667, @@ -105,7 +145,12 @@ "regB_ref": 0.034868968961000446, "regB_star": 0.045860235685736495, "regA_ref": 0.034868968961000446, - "regA_star": 0.045860235685736495 + "regA_star": 0.045860235685736495, + "reg29_star_per_seed": [ + 1000.0, + 500.0670756532481, + 500.07857939015105 + ] }, "twin raw_b4": { "rate": 0.6222222222222222, @@ -117,7 +162,12 @@ "regB_ref": 0.031090565068918607, "regB_star": 0.04009868135354511, "regA_ref": 0.03602559875874334, - "regA_star": 0.04612835952042982 + "regA_star": 0.04612835952042982, + "reg29_star_per_seed": [ + 0.07311798148058501, + 0.07470892227613435, + 0.08088746958920823 + ] }, "twin raw_b16": { "rate": 0.6888888888888888, @@ -129,7 +179,12 @@ "regB_ref": 0.024827462390698996, "regB_star": 0.034008343863723534, "regA_ref": 0.03665811970701527, - "regA_star": 0.04772048027118436 + "regA_star": 0.04772048027118436, + "reg29_star_per_seed": [ + 0.05807689752517098, + 0.05422806624253773, + 0.05913398532637004 + ] }, "twin filt_b1": { "rate": 0.5722222222222222, @@ -141,7 +196,12 @@ "regB_ref": 0.035172887226527116, "regB_star": 0.045343068252056584, "regA_ref": 0.035172887226527116, - "regA_star": 0.045343068252056584 + "regA_star": 0.045343068252056584, + "reg29_star_per_seed": [ + 0.09196044154961569, + 0.10137589764619415, + 0.08672273104752559 + ] }, "twin filt_b4": { "rate": 0.6805555555555557, @@ -153,7 +213,12 @@ "regB_ref": 0.03138655281275926, "regB_star": 0.040342528272814926, "regA_ref": 0.036638098220030946, - "regA_star": 0.04700456890654414 + "regA_star": 0.04700456890654414, + "reg29_star_per_seed": [ + 0.06735180745496439, + 0.06821410044080367, + 0.06362610349884046 + ] }, "twin filt_b16": { "rate": 0.7305555555555555, @@ -165,7 +230,12 @@ "regB_ref": 0.02495787433019081, "regB_star": 0.03388894221642125, "regA_ref": 0.036800685855217674, - "regA_star": 0.04793953255697314 + "regA_star": 0.04793953255697314, + "reg29_star_per_seed": [ + 0.05279832218166869, + 0.05271963186300921, + 0.051832046588488945 + ] }, "knn raw_b1": { "rate": 0.25833333333333336, @@ -175,7 +245,10 @@ "regB_ref": 0.11371326220225075, "regB_star": 0.11629817415072874, "regA_ref": 0.11371326220225075, - "regA_star": 0.11629817415072874 + "regA_star": 0.11629817415072874, + "reg29_star_per_seed": [ + 1000.0 + ] }, "knn raw_b4": { "rate": 0.44166666666666665, @@ -185,7 +258,10 @@ "regB_ref": 0.09416819337804627, "regB_star": 0.11250915295445885, "regA_ref": 0.11635060647060991, - "regA_star": 0.13716816454409586 + "regA_star": 0.13716816454409586, + "reg29_star_per_seed": [ + 1000.0 + ] }, "knn raw_b16": { "rate": 0.7083333333333334, @@ -195,7 +271,10 @@ "regB_ref": 0.08590952578105893, "regB_star": 0.09869180446652481, "regA_ref": 0.13353007468957645, - "regA_star": 0.13956844190360695 + "regA_star": 0.13956844190360695, + "reg29_star_per_seed": [ + 0.1222650154352023 + ] }, "knn filt_b1": { "rate": 0.5083333333333333, @@ -205,7 +284,10 @@ "regB_ref": 0.134908830251387, "regB_star": 0.14090533433695862, "regA_ref": 0.134908830251387, - "regA_star": 0.14090533433695862 + "regA_star": 0.14090533433695862, + "reg29_star_per_seed": [ + 0.47128174901284803 + ] }, "knn filt_b4": { "rate": 0.7833333333333333, @@ -215,7 +297,10 @@ "regB_ref": 0.10139965849798827, "regB_star": 0.10879331316422458, "regA_ref": 0.13114353705654402, - "regA_star": 0.1383683032238514 + "regA_star": 0.1383683032238514, + "reg29_star_per_seed": [ + 0.12376717018326289 + ] }, "knn filt_b16": { "rate": 0.8666666666666667, @@ -225,7 +310,10 @@ "regB_ref": 0.07096639087530376, "regB_star": 0.08244864896963622, "regA_ref": 0.13353036702921328, - "regA_star": 0.1383683032238514 + "regA_star": 0.1383683032238514, + "reg29_star_per_seed": [ + 0.08899908416608437 + ] }, "knn ref_b16_n3": { "rate": 0.9333333333333333, @@ -235,7 +323,10 @@ "regB_ref": 0.07228077375089703, "regB_star": 0.0830961623057771, "regA_ref": 0.12499251210513573, - "regA_star": 0.13353036702921328 + "regA_star": 0.13353036702921328, + "reg29_star_per_seed": [ + 0.08746904759596996 + ] }, "knn ref_b16_n10": { "rate": 0.9333333333333333, @@ -245,6 +336,9 @@ "regB_ref": 0.07337219985527899, "regB_star": 0.08575503047710231, "regA_ref": 0.12802583666738943, - "regA_star": 0.13421974481011856 + "regA_star": 0.13421974481011856, + "reg29_star_per_seed": [ + 0.08835772743585302 + ] } } \ No newline at end of file diff --git a/results/icml_r3/X29/act/x27rescore_d3fm3n8000.txt b/results/icml_r3/X29/act/x27rescore_d3fm3n8000.txt index 9d432ed5659f7fbaf6baab4153a5a7d9de6e5871..18071411c59ae08921633c78f2587c81d12dfd7f 100644 --- a/results/icml_r3/X29/act/x27rescore_d3fm3n8000.txt +++ b/results/icml_r3/X29/act/x27rescore_d3fm3n8000.txt @@ -1,23 +1,23 @@ X29-A: X27's C-only arms re-scored, m = 3, tag d3fm3n8000, 120 test plants. J*_A = min(J_ref, 3A id and so3 labels) is below J_ref on 45 plants (median (J_ref - J*_A) / J*_A 0.000%). - diff raw_b1 certified 51.7% (published 51.7%) | cheapest certified: regret vs J_ref 3.52% (published 3.52%), vs J*_A 4.94% | first certified: vs J_ref 3.52%, vs J*_A 4.94% - diff raw_b4 certified 76.1% (published 76.1%) | cheapest certified: regret vs J_ref 2.66% (published 2.66%), vs J*_A 3.65% | first certified: vs J_ref 3.91%, vs J*_A 5.27% - diff raw_b16 certified 94.4% (published 94.4%) | cheapest certified: regret vs J_ref 1.77% (published 1.77%), vs J*_A 2.54% | first certified: vs J_ref 3.98%, vs J*_A 5.12% - diff filt_b1 certified 68.6% (published 68.6%) | cheapest certified: regret vs J_ref 3.86% (published 3.86%), vs J*_A 5.15% | first certified: vs J_ref 3.86%, vs J*_A 5.15% - diff filt_b4 certified 92.8% (published 92.8%) | cheapest certified: regret vs J_ref 2.46% (published 2.46%), vs J*_A 3.28% | first certified: vs J_ref 3.89%, vs J*_A 5.09% - diff filt_b16 certified 98.6% (published 98.6%) | cheapest certified: regret vs J_ref 1.50% (published 1.50%), vs J*_A 2.18% | first certified: vs J_ref 3.98%, vs J*_A 5.09% - diff ref_b16_n3 certified 99.4% (published 99.4%) | cheapest certified: regret vs J_ref 1.50% (published 1.50%), vs J*_A 2.19% | first certified: vs J_ref 3.99%, vs J*_A 5.12% - diff ref_b16_n10 certified 99.7% (published 99.7%) | cheapest certified: regret vs J_ref 1.50% (published 1.50%), vs J*_A 2.21% | first certified: vs J_ref 4.01%, vs J*_A 5.15% - twin raw_b1 certified 49.2% (published 49.2%) | cheapest certified: regret vs J_ref 3.49% (published 3.49%), vs J*_A 4.59% | first certified: vs J_ref 3.49%, vs J*_A 4.59% - twin raw_b4 certified 62.2% (published 62.2%) | cheapest certified: regret vs J_ref 3.11% (published 3.11%), vs J*_A 4.01% | first certified: vs J_ref 3.60%, vs J*_A 4.61% - twin raw_b16 certified 68.9% (published 68.9%) | cheapest certified: regret vs J_ref 2.48% (published 2.48%), vs J*_A 3.40% | first certified: vs J_ref 3.67%, vs J*_A 4.77% - twin filt_b1 certified 57.2% (published 57.2%) | cheapest certified: regret vs J_ref 3.52% (published 3.52%), vs J*_A 4.53% | first certified: vs J_ref 3.52%, vs J*_A 4.53% - twin filt_b4 certified 68.1% (published 68.1%) | cheapest certified: regret vs J_ref 3.14% (published 3.14%), vs J*_A 4.03% | first certified: vs J_ref 3.66%, vs J*_A 4.70% - twin filt_b16 certified 73.1% (published 73.1%) | cheapest certified: regret vs J_ref 2.50% (published 2.50%), vs J*_A 3.39% | first certified: vs J_ref 3.68%, vs J*_A 4.79% - knn raw_b1 certified 25.8% (published 25.8%) | cheapest certified: regret vs J_ref 11.37% (published 11.37%), vs J*_A 11.63% | first certified: vs J_ref 11.37%, vs J*_A 11.63% - knn raw_b4 certified 44.2% (published 44.2%) | cheapest certified: regret vs J_ref 9.42% (published 9.42%), vs J*_A 11.25% | first certified: vs J_ref 11.64%, vs J*_A 13.72% - knn raw_b16 certified 70.8% (published 70.8%) | cheapest certified: regret vs J_ref 8.59% (published 8.59%), vs J*_A 9.87% | first certified: vs J_ref 13.35%, vs J*_A 13.96% - knn filt_b1 certified 50.8% (published 50.8%) | cheapest certified: regret vs J_ref 13.49% (published 13.49%), vs J*_A 14.09% | first certified: vs J_ref 13.49%, vs J*_A 14.09% - knn filt_b4 certified 78.3% (published 78.3%) | cheapest certified: regret vs J_ref 10.14% (published 10.14%), vs J*_A 10.88% | first certified: vs J_ref 13.11%, vs J*_A 13.84% - knn filt_b16 certified 86.7% (published 86.7%) | cheapest certified: regret vs J_ref 7.10% (published 7.10%), vs J*_A 8.24% | first certified: vs J_ref 13.35%, vs J*_A 13.84% - knn ref_b16_n3 certified 93.3% (published 93.3%) | cheapest certified: regret vs J_ref 7.23% (published 7.23%), vs J*_A 8.31% | first certified: vs J_ref 12.50%, vs J*_A 13.35% - knn ref_b16_n10 certified 93.3% (published 93.3%) | cheapest certified: regret vs J_ref 7.34% (published 7.34%), vs J*_A 8.58% | first certified: vs J_ref 12.80%, vs J*_A 13.42% + diff raw_b1 certified 51.7% (published 51.7%) | cheapest certified: regret vs J_ref 3.52% (published 3.52%), vs J*_A 4.94% | first certified: vs J_ref 3.52%, vs J*_A 4.94% | X29 convention vs J*_A, per seed: 11.74% / 60.49% / n/a + diff raw_b4 certified 76.1% (published 76.1%) | cheapest certified: regret vs J_ref 2.66% (published 2.66%), vs J*_A 3.65% | first certified: vs J_ref 3.91%, vs J*_A 5.27% | X29 convention vs J*_A, per seed: 5.47% / 5.11% / 5.15% + diff raw_b16 certified 94.4% (published 94.4%) | cheapest certified: regret vs J_ref 1.77% (published 1.77%), vs J*_A 2.54% | first certified: vs J_ref 3.98%, vs J*_A 5.12% | X29 convention vs J*_A, per seed: 2.58% / 2.95% / 2.77% + diff filt_b1 certified 68.6% (published 68.6%) | cheapest certified: regret vs J_ref 3.86% (published 3.86%), vs J*_A 5.15% | first certified: vs J_ref 3.86%, vs J*_A 5.15% | X29 convention vs J*_A, per seed: 7.64% / 7.43% / 10.77% + diff filt_b4 certified 92.8% (published 92.8%) | cheapest certified: regret vs J_ref 2.46% (published 2.46%), vs J*_A 3.28% | first certified: vs J_ref 3.89%, vs J*_A 5.09% | X29 convention vs J*_A, per seed: 3.56% / 3.86% / 3.22% + diff filt_b16 certified 98.6% (published 98.6%) | cheapest certified: regret vs J_ref 1.50% (published 1.50%), vs J*_A 2.18% | first certified: vs J_ref 3.98%, vs J*_A 5.09% | X29 convention vs J*_A, per seed: 2.35% / 2.33% / 2.03% + diff ref_b16_n3 certified 99.4% (published 99.4%) | cheapest certified: regret vs J_ref 1.50% (published 1.50%), vs J*_A 2.19% | first certified: vs J_ref 3.99%, vs J*_A 5.12% | X29 convention vs J*_A, per seed: 2.35% / 2.33% / 1.98% + diff ref_b16_n10 certified 99.7% (published 99.7%) | cheapest certified: regret vs J_ref 1.50% (published 1.50%), vs J*_A 2.21% | first certified: vs J_ref 4.01%, vs J*_A 5.15% | X29 convention vs J*_A, per seed: 2.35% / 2.33% / 1.98% + twin raw_b1 certified 49.2% (published 49.2%) | cheapest certified: regret vs J_ref 3.49% (published 3.49%), vs J*_A 4.59% | first certified: vs J_ref 3.49%, vs J*_A 4.59% | X29 convention vs J*_A, per seed: n/a / n/a / n/a + twin raw_b4 certified 62.2% (published 62.2%) | cheapest certified: regret vs J_ref 3.11% (published 3.11%), vs J*_A 4.01% | first certified: vs J_ref 3.60%, vs J*_A 4.61% | X29 convention vs J*_A, per seed: 7.31% / 7.47% / 8.09% + twin raw_b16 certified 68.9% (published 68.9%) | cheapest certified: regret vs J_ref 2.48% (published 2.48%), vs J*_A 3.40% | first certified: vs J_ref 3.67%, vs J*_A 4.77% | X29 convention vs J*_A, per seed: 5.81% / 5.42% / 5.91% + twin filt_b1 certified 57.2% (published 57.2%) | cheapest certified: regret vs J_ref 3.52% (published 3.52%), vs J*_A 4.53% | first certified: vs J_ref 3.52%, vs J*_A 4.53% | X29 convention vs J*_A, per seed: 9.20% / 10.14% / 8.67% + twin filt_b4 certified 68.1% (published 68.1%) | cheapest certified: regret vs J_ref 3.14% (published 3.14%), vs J*_A 4.03% | first certified: vs J_ref 3.66%, vs J*_A 4.70% | X29 convention vs J*_A, per seed: 6.74% / 6.82% / 6.36% + twin filt_b16 certified 73.1% (published 73.1%) | cheapest certified: regret vs J_ref 2.50% (published 2.50%), vs J*_A 3.39% | first certified: vs J_ref 3.68%, vs J*_A 4.79% | X29 convention vs J*_A, per seed: 5.28% / 5.27% / 5.18% + knn raw_b1 certified 25.8% (published 25.8%) | cheapest certified: regret vs J_ref 11.37% (published 11.37%), vs J*_A 11.63% | first certified: vs J_ref 11.37%, vs J*_A 11.63% | X29 convention vs J*_A, per seed: n/a + knn raw_b4 certified 44.2% (published 44.2%) | cheapest certified: regret vs J_ref 9.42% (published 9.42%), vs J*_A 11.25% | first certified: vs J_ref 11.64%, vs J*_A 13.72% | X29 convention vs J*_A, per seed: n/a + knn raw_b16 certified 70.8% (published 70.8%) | cheapest certified: regret vs J_ref 8.59% (published 8.59%), vs J*_A 9.87% | first certified: vs J_ref 13.35%, vs J*_A 13.96% | X29 convention vs J*_A, per seed: 12.23% + knn filt_b1 certified 50.8% (published 50.8%) | cheapest certified: regret vs J_ref 13.49% (published 13.49%), vs J*_A 14.09% | first certified: vs J_ref 13.49%, vs J*_A 14.09% | X29 convention vs J*_A, per seed: 47.13% + knn filt_b4 certified 78.3% (published 78.3%) | cheapest certified: regret vs J_ref 10.14% (published 10.14%), vs J*_A 10.88% | first certified: vs J_ref 13.11%, vs J*_A 13.84% | X29 convention vs J*_A, per seed: 12.38% + knn filt_b16 certified 86.7% (published 86.7%) | cheapest certified: regret vs J_ref 7.10% (published 7.10%), vs J*_A 8.24% | first certified: vs J_ref 13.35%, vs J*_A 13.84% | X29 convention vs J*_A, per seed: 8.90% + knn ref_b16_n3 certified 93.3% (published 93.3%) | cheapest certified: regret vs J_ref 7.23% (published 7.23%), vs J*_A 8.31% | first certified: vs J_ref 12.50%, vs J*_A 13.35% | X29 convention vs J*_A, per seed: 8.75% + knn ref_b16_n10 certified 93.3% (published 93.3%) | cheapest certified: regret vs J_ref 7.34% (published 7.34%), vs J*_A 8.58% | first certified: vs J_ref 12.80%, vs J*_A 13.42% | X29 convention vs J*_A, per seed: 8.84% diff --git a/results/icml_r3/X29/act/x27rescore_d3fm4n8000.json b/results/icml_r3/X29/act/x27rescore_d3fm4n8000.json index 90de168195688d13d972996747469b1fa646b1e9..217416842b5481a743ea776a769762789f4ebbec 100644 --- a/results/icml_r3/X29/act/x27rescore_d3fm4n8000.json +++ b/results/icml_r3/X29/act/x27rescore_d3fm4n8000.json @@ -9,7 +9,12 @@ "regB_ref": 0.04281187301679423, "regB_star": 0.04962915968635695, "regA_ref": 0.04281187301679423, - "regA_star": 0.04962915968635695 + "regA_star": 0.04962915968635695, + "reg29_star_per_seed": [ + 1000.0, + 1000.0, + 1000.0 + ] }, "diff raw_b4": { "rate": 0.5722222222222222, @@ -21,7 +26,12 @@ "regB_ref": 0.04023679269097036, "regB_star": 0.047381757855627926, "regA_ref": 0.04831828056771548, - "regA_star": 0.057019597285727364 + "regA_star": 0.057019597285727364, + "reg29_star_per_seed": [ + 0.08495044681003916, + 0.0881141812966516, + 0.11122677860139785 + ] }, "diff raw_b16": { "rate": 0.7888888888888889, @@ -33,7 +43,12 @@ "regB_ref": 0.03206114493999934, "regB_star": 0.03878398370676894, "regA_ref": 0.05338276992090041, - "regA_star": 0.05942518962649945 + "regA_star": 0.05942518962649945, + "reg29_star_per_seed": [ + 0.047293419441651996, + 0.05764590082594878, + 0.05264291865089865 + ] }, "diff filt_b1": { "rate": 0.5249999999999999, @@ -45,7 +60,12 @@ "regB_ref": 0.05256149004484412, "regB_star": 0.05789482111431554, "regA_ref": 0.05256149004484412, - "regA_star": 0.05789482111431554 + "regA_star": 0.05789482111431554, + "reg29_star_per_seed": [ + 0.263211143468268, + 0.12940601631344728, + 0.14249857544129063 + ] }, "diff filt_b4": { "rate": 0.8250000000000001, @@ -57,7 +77,12 @@ "regB_ref": 0.04154891326937804, "regB_star": 0.05096408010028841, "regA_ref": 0.05679915606087227, - "regA_star": 0.06378147142694024 + "regA_star": 0.06378147142694024, + "reg29_star_per_seed": [ + 0.06236438872575767, + 0.06424515800692798, + 0.060460629694771506 + ] }, "diff filt_b16": { "rate": 0.9194444444444444, @@ -69,7 +94,12 @@ "regB_ref": 0.030428223592535053, "regB_star": 0.03729421986230963, "regA_ref": 0.05678969283770341, - "regA_star": 0.06378147142694024 + "regA_star": 0.06378147142694024, + "reg29_star_per_seed": [ + 0.038550378977868505, + 0.04405060528876292, + 0.03878398370676894 + ] }, "diff ref_b16_n3": { "rate": 0.9666666666666667, @@ -81,7 +111,12 @@ "regB_ref": 0.032163477351268455, "regB_star": 0.03848414313894111, "regA_ref": 0.05752555203944998, - "regA_star": 0.06417574626693279 + "regA_star": 0.06417574626693279, + "reg29_star_per_seed": [ + 0.038048491177176014, + 0.04358892940577752, + 0.03850457199311308 + ] }, "diff ref_b16_n10": { "rate": 0.9777777777777777, @@ -93,7 +128,12 @@ "regB_ref": 0.03239370322615842, "regB_star": 0.03848414313894111, "regA_ref": 0.0571452435546439, - "regA_star": 0.0639596586478054 + "regA_star": 0.0639596586478054, + "reg29_star_per_seed": [ + 0.0375075533219793, + 0.04358892940577752, + 0.037786990412120525 + ] }, "twin raw_b1": { "rate": 0.3138888888888889, @@ -105,7 +145,12 @@ "regB_ref": 0.05077043279796922, "regB_star": 0.054942478154655694, "regA_ref": 0.05077043279796922, - "regA_star": 0.054942478154655694 + "regA_star": 0.054942478154655694, + "reg29_star_per_seed": [ + 1000.0, + 1000.0, + 1000.0 + ] }, "twin raw_b4": { "rate": 0.4305555555555555, @@ -117,7 +162,12 @@ "regB_ref": 0.040770558505952126, "regB_star": 0.04486400154999837, "regA_ref": 0.044869776269671036, - "regA_star": 0.051729042499672806 + "regA_star": 0.051729042499672806, + "reg29_star_per_seed": [ + 1000.0, + 1000.0, + 1000.0 + ] }, "twin raw_b16": { "rate": 0.48333333333333334, @@ -129,7 +179,12 @@ "regB_ref": 0.03419325650322769, "regB_star": 0.03997382209205025, "regA_ref": 0.04478727476519462, - "regA_star": 0.051812151699132114 + "regA_star": 0.051812151699132114, + "reg29_star_per_seed": [ + 1000.0, + 1000.0, + 500.05918359518233 + ] }, "twin filt_b1": { "rate": 0.3666666666666667, @@ -141,7 +196,12 @@ "regB_ref": 0.0509702614716806, "regB_star": 0.05496224880262157, "regA_ref": 0.0509702614716806, - "regA_star": 0.05496224880262157 + "regA_star": 0.05496224880262157, + "reg29_star_per_seed": [ + 1000.0, + 1000.0, + 1000.0 + ] }, "twin filt_b4": { "rate": 0.4861111111111111, @@ -153,7 +213,12 @@ "regB_ref": 0.039893127429255326, "regB_star": 0.044859535745951584, "regA_ref": 0.044869776269671036, - "regA_star": 0.051729042499672806 + "regA_star": 0.051729042499672806, + "reg29_star_per_seed": [ + 1000.0, + 1000.0, + 500.06559232249737 + ] }, "twin filt_b16": { "rate": 0.5222222222222221, @@ -165,7 +230,12 @@ "regB_ref": 0.03461930665839119, "regB_star": 0.039952457345226344, "regA_ref": 0.045169830011552614, - "regA_star": 0.05347942435820763 + "regA_star": 0.05347942435820763, + "reg29_star_per_seed": [ + 0.13461082478981312, + 0.13603789452203452, + 0.09103587528874801 + ] }, "knn raw_b1": { "rate": 0.14166666666666666, @@ -175,7 +245,10 @@ "regB_ref": 0.11972585447859752, "regB_star": 0.1203804444936909, "regA_ref": 0.11972585447859752, - "regA_star": 0.1203804444936909 + "regA_star": 0.1203804444936909, + "reg29_star_per_seed": [ + 1000.0 + ] }, "knn raw_b4": { "rate": 0.39166666666666666, @@ -185,7 +258,10 @@ "regB_ref": 0.11972585447859752, "regB_star": 0.1249036336281455, "regA_ref": 0.1249036336281455, - "regA_star": 0.13069438483572582 + "regA_star": 0.13069438483572582, + "reg29_star_per_seed": [ + 1000.0 + ] }, "knn raw_b16": { "rate": 0.5916666666666667, @@ -195,7 +271,10 @@ "regB_ref": 0.10947876745055107, "regB_star": 0.11616937090964607, "regA_ref": 0.13058469845406107, - "regA_star": 0.1400175969983004 + "regA_star": 0.1400175969983004, + "reg29_star_per_seed": [ + 0.1783168905724013 + ] }, "knn filt_b1": { "rate": 0.45, @@ -205,7 +284,10 @@ "regB_ref": 0.11863223190950545, "regB_star": 0.12336736317427233, "regA_ref": 0.11863223190950545, - "regA_star": 0.12336736317427233 + "regA_star": 0.12336736317427233, + "reg29_star_per_seed": [ + 1000.0 + ] }, "knn filt_b4": { "rate": 0.75, @@ -215,7 +297,10 @@ "regB_ref": 0.11100685037250602, "regB_star": 0.11698292149647704, "regA_ref": 0.13511513600466607, - "regA_star": 0.14419869136826147 + "regA_star": 0.14419869136826147, + "reg29_star_per_seed": [ + 0.1489442082590664 + ] }, "knn filt_b16": { "rate": 0.7916666666666666, @@ -225,7 +310,10 @@ "regB_ref": 0.0926797810653952, "regB_star": 0.09917966684483925, "regA_ref": 0.1400175969983004, - "regA_star": 0.14697604799704078 + "regA_star": 0.14697604799704078, + "reg29_star_per_seed": [ + 0.11159647642534298 + ] }, "knn ref_b16_n3": { "rate": 0.9, @@ -235,7 +323,10 @@ "regB_ref": 0.09150018593164855, "regB_star": 0.09801292912248993, "regA_ref": 0.12780736488049338, - "regA_star": 0.13983158527678574 + "regA_star": 0.13983158527678574, + "reg29_star_per_seed": [ + 0.10582831324537034 + ] }, "knn ref_b16_n10": { "rate": 0.9333333333333333, @@ -245,6 +336,9 @@ "regB_ref": 0.09026618689333521, "regB_star": 0.09677288836815534, "regA_ref": 0.1258708743514112, - "regA_star": 0.1349668764575651 + "regA_star": 0.1349668764575651, + "reg29_star_per_seed": [ + 0.10014547921930417 + ] } } \ No newline at end of file diff --git a/results/icml_r3/X29/act/x27rescore_d3fm4n8000.txt b/results/icml_r3/X29/act/x27rescore_d3fm4n8000.txt index 84e82cec0ff41f9fb26efd5ff5a5f43ce563d223..44cb80820732676aaf9eebbc71d4ac5692c99c26 100644 --- a/results/icml_r3/X29/act/x27rescore_d3fm4n8000.txt +++ b/results/icml_r3/X29/act/x27rescore_d3fm4n8000.txt @@ -1,23 +1,23 @@ X29-A: X27's C-only arms re-scored, m = 4, tag d3fm4n8000, 120 test plants. J*_A = min(J_ref, 3A id and so3 labels) is below J_ref on 48 plants (median (J_ref - J*_A) / J*_A 0.000%). - diff raw_b1 certified 31.7% (published 31.7%) | cheapest certified: regret vs J_ref 4.28% (published 4.28%), vs J*_A 4.96% | first certified: vs J_ref 4.28%, vs J*_A 4.96% - diff raw_b4 certified 57.2% (published 57.2%) | cheapest certified: regret vs J_ref 4.02% (published 4.02%), vs J*_A 4.74% | first certified: vs J_ref 4.83%, vs J*_A 5.70% - diff raw_b16 certified 78.9% (published 78.9%) | cheapest certified: regret vs J_ref 3.21% (published 3.21%), vs J*_A 3.88% | first certified: vs J_ref 5.34%, vs J*_A 5.94% - diff filt_b1 certified 52.5% (published 52.5%) | cheapest certified: regret vs J_ref 5.26% (published 5.26%), vs J*_A 5.79% | first certified: vs J_ref 5.26%, vs J*_A 5.79% - diff filt_b4 certified 82.5% (published 82.5%) | cheapest certified: regret vs J_ref 4.15% (published 4.15%), vs J*_A 5.10% | first certified: vs J_ref 5.68%, vs J*_A 6.38% - diff filt_b16 certified 91.9% (published 91.9%) | cheapest certified: regret vs J_ref 3.04% (published 3.04%), vs J*_A 3.73% | first certified: vs J_ref 5.68%, vs J*_A 6.38% - diff ref_b16_n3 certified 96.7% (published 96.7%) | cheapest certified: regret vs J_ref 3.22% (published 3.22%), vs J*_A 3.85% | first certified: vs J_ref 5.75%, vs J*_A 6.42% - diff ref_b16_n10 certified 97.8% (published 97.8%) | cheapest certified: regret vs J_ref 3.24% (published 3.24%), vs J*_A 3.85% | first certified: vs J_ref 5.71%, vs J*_A 6.40% - twin raw_b1 certified 31.4% (published 31.4%) | cheapest certified: regret vs J_ref 5.08% (published 5.08%), vs J*_A 5.49% | first certified: vs J_ref 5.08%, vs J*_A 5.49% - twin raw_b4 certified 43.1% (published 43.1%) | cheapest certified: regret vs J_ref 4.08% (published 4.08%), vs J*_A 4.49% | first certified: vs J_ref 4.49%, vs J*_A 5.17% - twin raw_b16 certified 48.3% (published 48.3%) | cheapest certified: regret vs J_ref 3.42% (published 3.42%), vs J*_A 4.00% | first certified: vs J_ref 4.48%, vs J*_A 5.18% - twin filt_b1 certified 36.7% (published 36.7%) | cheapest certified: regret vs J_ref 5.10% (published 5.10%), vs J*_A 5.50% | first certified: vs J_ref 5.10%, vs J*_A 5.50% - twin filt_b4 certified 48.6% (published 48.6%) | cheapest certified: regret vs J_ref 3.99% (published 3.99%), vs J*_A 4.49% | first certified: vs J_ref 4.49%, vs J*_A 5.17% - twin filt_b16 certified 52.2% (published 52.2%) | cheapest certified: regret vs J_ref 3.46% (published 3.46%), vs J*_A 4.00% | first certified: vs J_ref 4.52%, vs J*_A 5.35% - knn raw_b1 certified 14.2% (published 14.2%) | cheapest certified: regret vs J_ref 11.97% (published 11.97%), vs J*_A 12.04% | first certified: vs J_ref 11.97%, vs J*_A 12.04% - knn raw_b4 certified 39.2% (published 39.2%) | cheapest certified: regret vs J_ref 11.97% (published 11.97%), vs J*_A 12.49% | first certified: vs J_ref 12.49%, vs J*_A 13.07% - knn raw_b16 certified 59.2% (published 59.2%) | cheapest certified: regret vs J_ref 10.95% (published 10.95%), vs J*_A 11.62% | first certified: vs J_ref 13.06%, vs J*_A 14.00% - knn filt_b1 certified 45.0% (published 45.0%) | cheapest certified: regret vs J_ref 11.86% (published 11.86%), vs J*_A 12.34% | first certified: vs J_ref 11.86%, vs J*_A 12.34% - knn filt_b4 certified 75.0% (published 75.0%) | cheapest certified: regret vs J_ref 11.10% (published 11.10%), vs J*_A 11.70% | first certified: vs J_ref 13.51%, vs J*_A 14.42% - knn filt_b16 certified 79.2% (published 79.2%) | cheapest certified: regret vs J_ref 9.27% (published 9.27%), vs J*_A 9.92% | first certified: vs J_ref 14.00%, vs J*_A 14.70% - knn ref_b16_n3 certified 90.0% (published 90.0%) | cheapest certified: regret vs J_ref 9.15% (published 9.15%), vs J*_A 9.80% | first certified: vs J_ref 12.78%, vs J*_A 13.98% - knn ref_b16_n10 certified 93.3% (published 93.3%) | cheapest certified: regret vs J_ref 9.03% (published 9.03%), vs J*_A 9.68% | first certified: vs J_ref 12.59%, vs J*_A 13.50% + diff raw_b1 certified 31.7% (published 31.7%) | cheapest certified: regret vs J_ref 4.28% (published 4.28%), vs J*_A 4.96% | first certified: vs J_ref 4.28%, vs J*_A 4.96% | X29 convention vs J*_A, per seed: n/a / n/a / n/a + diff raw_b4 certified 57.2% (published 57.2%) | cheapest certified: regret vs J_ref 4.02% (published 4.02%), vs J*_A 4.74% | first certified: vs J_ref 4.83%, vs J*_A 5.70% | X29 convention vs J*_A, per seed: 8.50% / 8.81% / 11.12% + diff raw_b16 certified 78.9% (published 78.9%) | cheapest certified: regret vs J_ref 3.21% (published 3.21%), vs J*_A 3.88% | first certified: vs J_ref 5.34%, vs J*_A 5.94% | X29 convention vs J*_A, per seed: 4.73% / 5.76% / 5.26% + diff filt_b1 certified 52.5% (published 52.5%) | cheapest certified: regret vs J_ref 5.26% (published 5.26%), vs J*_A 5.79% | first certified: vs J_ref 5.26%, vs J*_A 5.79% | X29 convention vs J*_A, per seed: 26.32% / 12.94% / 14.25% + diff filt_b4 certified 82.5% (published 82.5%) | cheapest certified: regret vs J_ref 4.15% (published 4.15%), vs J*_A 5.10% | first certified: vs J_ref 5.68%, vs J*_A 6.38% | X29 convention vs J*_A, per seed: 6.24% / 6.42% / 6.05% + diff filt_b16 certified 91.9% (published 91.9%) | cheapest certified: regret vs J_ref 3.04% (published 3.04%), vs J*_A 3.73% | first certified: vs J_ref 5.68%, vs J*_A 6.38% | X29 convention vs J*_A, per seed: 3.86% / 4.41% / 3.88% + diff ref_b16_n3 certified 96.7% (published 96.7%) | cheapest certified: regret vs J_ref 3.22% (published 3.22%), vs J*_A 3.85% | first certified: vs J_ref 5.75%, vs J*_A 6.42% | X29 convention vs J*_A, per seed: 3.80% / 4.36% / 3.85% + diff ref_b16_n10 certified 97.8% (published 97.8%) | cheapest certified: regret vs J_ref 3.24% (published 3.24%), vs J*_A 3.85% | first certified: vs J_ref 5.71%, vs J*_A 6.40% | X29 convention vs J*_A, per seed: 3.75% / 4.36% / 3.78% + twin raw_b1 certified 31.4% (published 31.4%) | cheapest certified: regret vs J_ref 5.08% (published 5.08%), vs J*_A 5.49% | first certified: vs J_ref 5.08%, vs J*_A 5.49% | X29 convention vs J*_A, per seed: n/a / n/a / n/a + twin raw_b4 certified 43.1% (published 43.1%) | cheapest certified: regret vs J_ref 4.08% (published 4.08%), vs J*_A 4.49% | first certified: vs J_ref 4.49%, vs J*_A 5.17% | X29 convention vs J*_A, per seed: n/a / n/a / n/a + twin raw_b16 certified 48.3% (published 48.3%) | cheapest certified: regret vs J_ref 3.42% (published 3.42%), vs J*_A 4.00% | first certified: vs J_ref 4.48%, vs J*_A 5.18% | X29 convention vs J*_A, per seed: n/a / n/a / n/a + twin filt_b1 certified 36.7% (published 36.7%) | cheapest certified: regret vs J_ref 5.10% (published 5.10%), vs J*_A 5.50% | first certified: vs J_ref 5.10%, vs J*_A 5.50% | X29 convention vs J*_A, per seed: n/a / n/a / n/a + twin filt_b4 certified 48.6% (published 48.6%) | cheapest certified: regret vs J_ref 3.99% (published 3.99%), vs J*_A 4.49% | first certified: vs J_ref 4.49%, vs J*_A 5.17% | X29 convention vs J*_A, per seed: n/a / n/a / n/a + twin filt_b16 certified 52.2% (published 52.2%) | cheapest certified: regret vs J_ref 3.46% (published 3.46%), vs J*_A 4.00% | first certified: vs J_ref 4.52%, vs J*_A 5.35% | X29 convention vs J*_A, per seed: 13.46% / 13.60% / 9.10% + knn raw_b1 certified 14.2% (published 14.2%) | cheapest certified: regret vs J_ref 11.97% (published 11.97%), vs J*_A 12.04% | first certified: vs J_ref 11.97%, vs J*_A 12.04% | X29 convention vs J*_A, per seed: n/a + knn raw_b4 certified 39.2% (published 39.2%) | cheapest certified: regret vs J_ref 11.97% (published 11.97%), vs J*_A 12.49% | first certified: vs J_ref 12.49%, vs J*_A 13.07% | X29 convention vs J*_A, per seed: n/a + knn raw_b16 certified 59.2% (published 59.2%) | cheapest certified: regret vs J_ref 10.95% (published 10.95%), vs J*_A 11.62% | first certified: vs J_ref 13.06%, vs J*_A 14.00% | X29 convention vs J*_A, per seed: 17.83% + knn filt_b1 certified 45.0% (published 45.0%) | cheapest certified: regret vs J_ref 11.86% (published 11.86%), vs J*_A 12.34% | first certified: vs J_ref 11.86%, vs J*_A 12.34% | X29 convention vs J*_A, per seed: n/a + knn filt_b4 certified 75.0% (published 75.0%) | cheapest certified: regret vs J_ref 11.10% (published 11.10%), vs J*_A 11.70% | first certified: vs J_ref 13.51%, vs J*_A 14.42% | X29 convention vs J*_A, per seed: 14.89% + knn filt_b16 certified 79.2% (published 79.2%) | cheapest certified: regret vs J_ref 9.27% (published 9.27%), vs J*_A 9.92% | first certified: vs J_ref 14.00%, vs J*_A 14.70% | X29 convention vs J*_A, per seed: 11.16% + knn ref_b16_n3 certified 90.0% (published 90.0%) | cheapest certified: regret vs J_ref 9.15% (published 9.15%), vs J*_A 9.80% | first certified: vs J_ref 12.78%, vs J*_A 13.98% | X29 convention vs J*_A, per seed: 10.58% + knn ref_b16_n10 certified 93.3% (published 93.3%) | cheapest certified: regret vs J_ref 9.03% (published 9.03%), vs J*_A 9.68% | first certified: vs J_ref 12.59%, vs J*_A 13.50% | X29 convention vs J*_A, per seed: 10.01% diff --git a/results/icml_r3/X29/act/x27rescore_d3fm5n16000.json b/results/icml_r3/X29/act/x27rescore_d3fm5n16000.json index 91f53454029d695b9b9ffc87a835ebb6af84b1a7..19755acd75a1389b75a0fe2e6ad82b341710b318 100644 --- a/results/icml_r3/X29/act/x27rescore_d3fm5n16000.json +++ b/results/icml_r3/X29/act/x27rescore_d3fm5n16000.json @@ -9,7 +9,12 @@ "regB_ref": 0.054012242469847704, "regB_star": 0.06580516710136042, "regA_ref": 0.054012242469847704, - "regA_star": 0.06580516710136042 + "regA_star": 0.06580516710136042, + "reg29_star_per_seed": [ + 1000.0, + 1000.0, + 1000.0 + ] }, "diff raw_b4": { "rate": 0.49166666666666664, @@ -21,7 +26,12 @@ "regB_ref": 0.046037766193027574, "regB_star": 0.055668722380055824, "regA_ref": 0.05123443031809827, - "regA_star": 0.06242150229911836 + "regA_star": 0.06242150229911836, + "reg29_star_per_seed": [ + 0.19219722967026764, + 0.10473329948011612, + 1000.0 + ] }, "diff raw_b16": { "rate": 0.7916666666666666, @@ -33,7 +43,12 @@ "regB_ref": 0.0392393348275164, "regB_star": 0.04843269982130982, "regA_ref": 0.053670339354187746, - "regA_star": 0.0653423576378871 + "regA_star": 0.0653423576378871, + "reg29_star_per_seed": [ + 0.056011538175283704, + 0.05579918124137806, + 0.0638180447639215 + ] }, "diff filt_b1": { "rate": 0.4583333333333333, @@ -45,7 +60,12 @@ "regB_ref": 0.05194845381582125, "regB_star": 0.06513679765481717, "regA_ref": 0.05194845381582125, - "regA_star": 0.06513679765481717 + "regA_star": 0.06513679765481717, + "reg29_star_per_seed": [ + 1000.0, + 1000.0, + 1000.0 + ] }, "diff filt_b4": { "rate": 0.8138888888888888, @@ -57,7 +77,12 @@ "regB_ref": 0.044054119434560945, "regB_star": 0.05117955925012052, "regA_ref": 0.053670339354187746, - "regA_star": 0.06526846423539756 + "regA_star": 0.06526846423539756, + "reg29_star_per_seed": [ + 0.057999843375380555, + 0.06110192291621441, + 0.06608581358546517 + ] }, "diff filt_b16": { "rate": 0.9083333333333333, @@ -69,7 +94,12 @@ "regB_ref": 0.033760278025647406, "regB_star": 0.0392393348275164, "regA_ref": 0.05494152341582326, - "regA_star": 0.06614503852117859 + "regA_star": 0.06614503852117859, + "reg29_star_per_seed": [ + 0.041296215258291746, + 0.039501202588679285, + 0.04825939970362869 + ] }, "diff ref_b16_n3": { "rate": 0.9638888888888889, @@ -81,7 +111,12 @@ "regB_ref": 0.034359315053998474, "regB_star": 0.039602163709273386, "regA_ref": 0.056236553327202676, - "regA_star": 0.06713280900832053 + "regA_star": 0.06713280900832053, + "reg29_star_per_seed": [ + 0.041296215258291746, + 0.03844028224462015, + 0.04449522945084139 + ] }, "diff ref_b16_n10": { "rate": 0.9805555555555556, @@ -93,7 +128,12 @@ "regB_ref": 0.03437394402248328, "regB_star": 0.040009974164940454, "regA_ref": 0.05649656778792678, - "regA_star": 0.06751706328759521 + "regA_star": 0.06751706328759521, + "reg29_star_per_seed": [ + 0.041296215258291746, + 0.037411175602180435, + 0.04245451078867202 + ] }, "twin raw_b1": { "rate": 0.24722222222222223, @@ -105,7 +145,12 @@ "regB_ref": 0.04588446769434418, "regB_star": 0.05281368503715744, "regA_ref": 0.04588446769434418, - "regA_star": 0.05281368503715744 + "regA_star": 0.05281368503715744, + "reg29_star_per_seed": [ + 1000.0, + 1000.0, + 1000.0 + ] }, "twin raw_b4": { "rate": 0.37777777777777777, @@ -117,7 +162,12 @@ "regB_ref": 0.03958246856186798, "regB_star": 0.046969980502976294, "regA_ref": 0.04453505836815008, - "regA_star": 0.05310045978676048 + "regA_star": 0.05310045978676048, + "reg29_star_per_seed": [ + 1000.0, + 1000.0, + 1000.0 + ] }, "twin raw_b16": { "rate": 0.4916666666666667, @@ -129,7 +179,12 @@ "regB_ref": 0.03635521260826646, "regB_star": 0.046204610388273615, "regA_ref": 0.04846464655537219, - "regA_star": 0.05641944870545168 + "regA_star": 0.05641944870545168, + "reg29_star_per_seed": [ + 0.10244921887598657, + 1000.0, + 0.11581804604445223 + ] }, "twin filt_b1": { "rate": 0.3416666666666666, @@ -141,7 +196,12 @@ "regB_ref": 0.04659602299391885, "regB_star": 0.053387234536363515, "regA_ref": 0.04659602299391885, - "regA_star": 0.053387234536363515 + "regA_star": 0.053387234536363515, + "reg29_star_per_seed": [ + 1000.0, + 1000.0, + 1000.0 + ] }, "twin filt_b4": { "rate": 0.4833333333333334, @@ -153,7 +213,12 @@ "regB_ref": 0.04074265857517956, "regB_star": 0.048658098886397605, "regA_ref": 0.046240245344131514, - "regA_star": 0.056035186950899485 + "regA_star": 0.056035186950899485, + "reg29_star_per_seed": [ + 0.09849242387393675, + 1000.0, + 1000.0 + ] }, "twin filt_b16": { "rate": 0.5555555555555556, @@ -165,7 +230,12 @@ "regB_ref": 0.03570862209728387, "regB_star": 0.04591678068291327, "regA_ref": 0.05002032485737595, - "regA_star": 0.057383941917565906 + "regA_star": 0.057383941917565906, + "reg29_star_per_seed": [ + 0.085614514090114, + 0.10824800868369489, + 0.0945664020595226 + ] }, "knn raw_b1": { "rate": 0.09166666666666666, @@ -175,7 +245,10 @@ "regB_ref": 0.18029208813957154, "regB_star": 0.18029208813957154, "regA_ref": 0.18029208813957154, - "regA_star": 0.18029208813957154 + "regA_star": 0.18029208813957154, + "reg29_star_per_seed": [ + 1000.0 + ] }, "knn raw_b4": { "rate": 0.24166666666666667, @@ -185,7 +258,10 @@ "regB_ref": 0.16093589699487887, "regB_star": 0.17212171903802753, "regA_ref": 0.1725441277384172, - "regA_star": 0.18523628247042523 + "regA_star": 0.18523628247042523, + "reg29_star_per_seed": [ + 1000.0 + ] }, "knn raw_b16": { "rate": 0.5166666666666667, @@ -195,7 +271,10 @@ "regB_ref": 0.1327768182319501, "regB_star": 0.14350847619758267, "regA_ref": 0.14856354038966635, - "regA_star": 0.16313087614552568 + "regA_star": 0.16313087614552568, + "reg29_star_per_seed": [ + 0.3633192275090701 + ] }, "knn filt_b1": { "rate": 0.3, @@ -205,7 +284,10 @@ "regB_ref": 0.17428865396751858, "regB_star": 0.18276418530499838, "regA_ref": 0.17428865396751858, - "regA_star": 0.18276418530499838 + "regA_star": 0.18276418530499838, + "reg29_star_per_seed": [ + 1000.0 + ] }, "knn filt_b4": { "rate": 0.6666666666666666, @@ -215,7 +297,10 @@ "regB_ref": 0.12985794400765538, "regB_star": 0.13483477262840815, "regA_ref": 0.1620537009612174, - "regA_star": 0.16564434998790312 + "regA_star": 0.16564434998790312, + "reg29_star_per_seed": [ + 0.17692463714776696 + ] }, "knn filt_b16": { "rate": 0.725, @@ -225,7 +310,10 @@ "regB_ref": 0.10686761298831438, "regB_star": 0.11477117848557294, "regA_ref": 0.16317150492755594, - "regA_star": 0.16567695056159626 + "regA_star": 0.16567695056159626, + "reg29_star_per_seed": [ + 0.1354804464718561 + ] }, "knn ref_b16_n3": { "rate": 0.9, @@ -235,7 +323,10 @@ "regB_ref": 0.10400741103859301, "regB_star": 0.1113356454533998, "regA_ref": 0.13930659114267874, - "regA_star": 0.15300463877630077 + "regA_star": 0.15300463877630077, + "reg29_star_per_seed": [ + 0.1173305502662011 + ] }, "knn ref_b16_n10": { "rate": 0.925, @@ -245,6 +336,9 @@ "regB_ref": 0.10343356710695706, "regB_star": 0.10973883506945237, "regA_ref": 0.13558071904802294, - "regA_star": 0.14891194803545904 + "regA_star": 0.14891194803545904, + "reg29_star_per_seed": [ + 0.11506558365541786 + ] } } \ No newline at end of file diff --git a/results/icml_r3/X29/act/x27rescore_d3fm5n16000.txt b/results/icml_r3/X29/act/x27rescore_d3fm5n16000.txt index bd1ee9fb0474cdf1a9ebbfe41322baad7fcd3e89..db0c1c44a9e195f36ad7495a96ba9f80b7e137c1 100644 --- a/results/icml_r3/X29/act/x27rescore_d3fm5n16000.txt +++ b/results/icml_r3/X29/act/x27rescore_d3fm5n16000.txt @@ -1,23 +1,23 @@ X29-A: X27's C-only arms re-scored, m = 5, tag d3fm5n16000, 120 test plants. J*_A = min(J_ref, 3A id and so3 labels) is below J_ref on 43 plants (median (J_ref - J*_A) / J*_A 0.000%). - diff raw_b1 certified 23.6% (published 23.6%) | cheapest certified: regret vs J_ref 5.40% (published 5.40%), vs J*_A 6.58% | first certified: vs J_ref 5.40%, vs J*_A 6.58% - diff raw_b4 certified 49.2% (published 49.2%) | cheapest certified: regret vs J_ref 4.60% (published 4.60%), vs J*_A 5.57% | first certified: vs J_ref 5.12%, vs J*_A 6.24% - diff raw_b16 certified 79.2% (published 79.2%) | cheapest certified: regret vs J_ref 3.92% (published 3.92%), vs J*_A 4.84% | first certified: vs J_ref 5.37%, vs J*_A 6.53% - diff filt_b1 certified 45.8% (published 45.8%) | cheapest certified: regret vs J_ref 5.19% (published 5.19%), vs J*_A 6.51% | first certified: vs J_ref 5.19%, vs J*_A 6.51% - diff filt_b4 certified 81.4% (published 81.4%) | cheapest certified: regret vs J_ref 4.41% (published 4.41%), vs J*_A 5.12% | first certified: vs J_ref 5.37%, vs J*_A 6.53% - diff filt_b16 certified 90.8% (published 90.8%) | cheapest certified: regret vs J_ref 3.38% (published 3.38%), vs J*_A 3.92% | first certified: vs J_ref 5.49%, vs J*_A 6.61% - diff ref_b16_n3 certified 96.4% (published 96.4%) | cheapest certified: regret vs J_ref 3.44% (published 3.44%), vs J*_A 3.96% | first certified: vs J_ref 5.62%, vs J*_A 6.71% - diff ref_b16_n10 certified 98.1% (published 98.1%) | cheapest certified: regret vs J_ref 3.44% (published 3.44%), vs J*_A 4.00% | first certified: vs J_ref 5.65%, vs J*_A 6.75% - twin raw_b1 certified 24.7% (published 24.7%) | cheapest certified: regret vs J_ref 4.59% (published 4.59%), vs J*_A 5.28% | first certified: vs J_ref 4.59%, vs J*_A 5.28% - twin raw_b4 certified 37.8% (published 37.8%) | cheapest certified: regret vs J_ref 3.96% (published 3.96%), vs J*_A 4.70% | first certified: vs J_ref 4.45%, vs J*_A 5.31% - twin raw_b16 certified 49.2% (published 49.2%) | cheapest certified: regret vs J_ref 3.64% (published 3.64%), vs J*_A 4.62% | first certified: vs J_ref 4.85%, vs J*_A 5.64% - twin filt_b1 certified 34.2% (published 34.2%) | cheapest certified: regret vs J_ref 4.66% (published 4.66%), vs J*_A 5.34% | first certified: vs J_ref 4.66%, vs J*_A 5.34% - twin filt_b4 certified 48.3% (published 48.3%) | cheapest certified: regret vs J_ref 4.07% (published 4.07%), vs J*_A 4.87% | first certified: vs J_ref 4.62%, vs J*_A 5.60% - twin filt_b16 certified 55.6% (published 55.6%) | cheapest certified: regret vs J_ref 3.57% (published 3.57%), vs J*_A 4.59% | first certified: vs J_ref 5.00%, vs J*_A 5.74% - knn raw_b1 certified 9.2% (published 9.2%) | cheapest certified: regret vs J_ref 18.03% (published 18.03%), vs J*_A 18.03% | first certified: vs J_ref 18.03%, vs J*_A 18.03% - knn raw_b4 certified 24.2% (published 24.2%) | cheapest certified: regret vs J_ref 16.09% (published 16.09%), vs J*_A 17.21% | first certified: vs J_ref 17.25%, vs J*_A 18.52% - knn raw_b16 certified 51.7% (published 51.7%) | cheapest certified: regret vs J_ref 13.28% (published 13.28%), vs J*_A 14.35% | first certified: vs J_ref 14.86%, vs J*_A 16.31% - knn filt_b1 certified 30.0% (published 30.0%) | cheapest certified: regret vs J_ref 17.43% (published 17.43%), vs J*_A 18.28% | first certified: vs J_ref 17.43%, vs J*_A 18.28% - knn filt_b4 certified 66.7% (published 66.7%) | cheapest certified: regret vs J_ref 12.99% (published 12.99%), vs J*_A 13.48% | first certified: vs J_ref 16.21%, vs J*_A 16.56% - knn filt_b16 certified 72.5% (published 72.5%) | cheapest certified: regret vs J_ref 10.69% (published 10.69%), vs J*_A 11.48% | first certified: vs J_ref 16.32%, vs J*_A 16.57% - knn ref_b16_n3 certified 90.0% (published 90.0%) | cheapest certified: regret vs J_ref 10.40% (published 10.40%), vs J*_A 11.13% | first certified: vs J_ref 13.93%, vs J*_A 15.30% - knn ref_b16_n10 certified 92.5% (published 92.5%) | cheapest certified: regret vs J_ref 10.34% (published 10.34%), vs J*_A 10.97% | first certified: vs J_ref 13.56%, vs J*_A 14.89% + diff raw_b1 certified 23.6% (published 23.6%) | cheapest certified: regret vs J_ref 5.40% (published 5.40%), vs J*_A 6.58% | first certified: vs J_ref 5.40%, vs J*_A 6.58% | X29 convention vs J*_A, per seed: n/a / n/a / n/a + diff raw_b4 certified 49.2% (published 49.2%) | cheapest certified: regret vs J_ref 4.60% (published 4.60%), vs J*_A 5.57% | first certified: vs J_ref 5.12%, vs J*_A 6.24% | X29 convention vs J*_A, per seed: 19.22% / 10.47% / n/a + diff raw_b16 certified 79.2% (published 79.2%) | cheapest certified: regret vs J_ref 3.92% (published 3.92%), vs J*_A 4.84% | first certified: vs J_ref 5.37%, vs J*_A 6.53% | X29 convention vs J*_A, per seed: 5.60% / 5.58% / 6.38% + diff filt_b1 certified 45.8% (published 45.8%) | cheapest certified: regret vs J_ref 5.19% (published 5.19%), vs J*_A 6.51% | first certified: vs J_ref 5.19%, vs J*_A 6.51% | X29 convention vs J*_A, per seed: n/a / n/a / n/a + diff filt_b4 certified 81.4% (published 81.4%) | cheapest certified: regret vs J_ref 4.41% (published 4.41%), vs J*_A 5.12% | first certified: vs J_ref 5.37%, vs J*_A 6.53% | X29 convention vs J*_A, per seed: 5.80% / 6.11% / 6.61% + diff filt_b16 certified 90.8% (published 90.8%) | cheapest certified: regret vs J_ref 3.38% (published 3.38%), vs J*_A 3.92% | first certified: vs J_ref 5.49%, vs J*_A 6.61% | X29 convention vs J*_A, per seed: 4.13% / 3.95% / 4.83% + diff ref_b16_n3 certified 96.4% (published 96.4%) | cheapest certified: regret vs J_ref 3.44% (published 3.44%), vs J*_A 3.96% | first certified: vs J_ref 5.62%, vs J*_A 6.71% | X29 convention vs J*_A, per seed: 4.13% / 3.84% / 4.45% + diff ref_b16_n10 certified 98.1% (published 98.1%) | cheapest certified: regret vs J_ref 3.44% (published 3.44%), vs J*_A 4.00% | first certified: vs J_ref 5.65%, vs J*_A 6.75% | X29 convention vs J*_A, per seed: 4.13% / 3.74% / 4.25% + twin raw_b1 certified 24.7% (published 24.7%) | cheapest certified: regret vs J_ref 4.59% (published 4.59%), vs J*_A 5.28% | first certified: vs J_ref 4.59%, vs J*_A 5.28% | X29 convention vs J*_A, per seed: n/a / n/a / n/a + twin raw_b4 certified 37.8% (published 37.8%) | cheapest certified: regret vs J_ref 3.96% (published 3.96%), vs J*_A 4.70% | first certified: vs J_ref 4.45%, vs J*_A 5.31% | X29 convention vs J*_A, per seed: n/a / n/a / n/a + twin raw_b16 certified 49.2% (published 49.2%) | cheapest certified: regret vs J_ref 3.64% (published 3.64%), vs J*_A 4.62% | first certified: vs J_ref 4.85%, vs J*_A 5.64% | X29 convention vs J*_A, per seed: 10.24% / n/a / 11.58% + twin filt_b1 certified 34.2% (published 34.2%) | cheapest certified: regret vs J_ref 4.66% (published 4.66%), vs J*_A 5.34% | first certified: vs J_ref 4.66%, vs J*_A 5.34% | X29 convention vs J*_A, per seed: n/a / n/a / n/a + twin filt_b4 certified 48.3% (published 48.3%) | cheapest certified: regret vs J_ref 4.07% (published 4.07%), vs J*_A 4.87% | first certified: vs J_ref 4.62%, vs J*_A 5.60% | X29 convention vs J*_A, per seed: 9.85% / n/a / n/a + twin filt_b16 certified 55.6% (published 55.6%) | cheapest certified: regret vs J_ref 3.57% (published 3.57%), vs J*_A 4.59% | first certified: vs J_ref 5.00%, vs J*_A 5.74% | X29 convention vs J*_A, per seed: 8.56% / 10.82% / 9.46% + knn raw_b1 certified 9.2% (published 9.2%) | cheapest certified: regret vs J_ref 18.03% (published 18.03%), vs J*_A 18.03% | first certified: vs J_ref 18.03%, vs J*_A 18.03% | X29 convention vs J*_A, per seed: n/a + knn raw_b4 certified 24.2% (published 24.2%) | cheapest certified: regret vs J_ref 16.09% (published 16.09%), vs J*_A 17.21% | first certified: vs J_ref 17.25%, vs J*_A 18.52% | X29 convention vs J*_A, per seed: n/a + knn raw_b16 certified 51.7% (published 51.7%) | cheapest certified: regret vs J_ref 13.28% (published 13.28%), vs J*_A 14.35% | first certified: vs J_ref 14.86%, vs J*_A 16.31% | X29 convention vs J*_A, per seed: 36.33% + knn filt_b1 certified 30.0% (published 30.0%) | cheapest certified: regret vs J_ref 17.43% (published 17.43%), vs J*_A 18.28% | first certified: vs J_ref 17.43%, vs J*_A 18.28% | X29 convention vs J*_A, per seed: n/a + knn filt_b4 certified 66.7% (published 66.7%) | cheapest certified: regret vs J_ref 12.99% (published 12.99%), vs J*_A 13.48% | first certified: vs J_ref 16.21%, vs J*_A 16.56% | X29 convention vs J*_A, per seed: 17.69% + knn filt_b16 certified 72.5% (published 72.5%) | cheapest certified: regret vs J_ref 10.69% (published 10.69%), vs J*_A 11.48% | first certified: vs J_ref 16.32%, vs J*_A 16.57% | X29 convention vs J*_A, per seed: 13.55% + knn ref_b16_n3 certified 90.0% (published 90.0%) | cheapest certified: regret vs J_ref 10.40% (published 10.40%), vs J*_A 11.13% | first certified: vs J_ref 13.93%, vs J*_A 15.30% | X29 convention vs J*_A, per seed: 11.73% + knn ref_b16_n10 certified 92.5% (published 92.5%) | cheapest certified: regret vs J_ref 10.34% (published 10.34%), vs J*_A 10.97% | first certified: vs J_ref 13.56%, vs J*_A 14.89% | X29 convention vs J*_A, per seed: 11.51% diff --git a/results/icml_r3/X29/siso/report.txt b/results/icml_r3/X29/siso/report.txt index 65b6f3ec80aec43dfc84e4ebd9be50a5c5155aed..908790d1db6e14c98016f523039ddbdb2eb15463 100644 --- a/results/icml_r3/X29/siso/report.txt +++ b/results/icml_r3/X29/siso/report.txt @@ -78,4 +78,25 @@ uncertified = 1e3; certified % / median regret [bootstrap 95% CI]; clip 1.5, t-r equivalence of the batched optimizers: C+phi 25 steps, plants [0, 1, 2]: J batched [0.089508 0.472122 0.018839] single [0.089508 0.472122 0.018839] used [1 1 0] [1 1 0] max rel diff 0.00e+00 -> ok == CPU (timing job) - not run yet + medians over timing plants (one thread each): fopt1 1553.8 s (n=10), fopt16 1686.5 s (n=10), fopt4 1518.1 s (n=10), gen_C+phi 29.1 s (n=10), gen_C-only 11.5 s (n=10), hifoo2 1.0 s (n=10), jopt1 1537.3 s (n=10), jopt16 1749.6 s (n=10), jopt4 1545.7 s (n=10), knn_C+phi 7.6 s (n=10), knn_C-only 9.5 s (n=10), twin_C+phi 17.2 s (n=10), twin_C-only 1.9 s (n=10) + C-only generator b=16 CPU 11.5 s | median regret 6.79% + C+phi generator b=16 CPU 29.1 s | median regret 7.14% + C-only generator b=1 CPU 0.7 s | median regret 54.90% + C+phi generator b=1 CPU 1.8 s | median regret 100000.00% + F-only optimizer 1 starts CPU 1554.8 s | median regret 35.91% + joint optimizer 1 starts CPU 3092.1 s | median regret 9.13% + F-only optimizer 2 starts CPU 1543.8 s | median regret 13.55% + joint optimizer 2 starts CPU 3083.9 s | median regret 4.39% + F-only optimizer 4 starts CPU 1522.0 s | median regret 8.11% + joint optimizer 4 starts CPU 3067.7 s | median regret 0.92% + F-only optimizer 8 starts CPU 1581.9 s | median regret 4.19% + joint optimizer 8 starts CPU 3195.6 s | median regret 0.00% + F-only optimizer 16 starts CPU 1701.8 s | median regret 3.12% + joint optimizer 16 starts CPU 3451.4 s | median regret 0.00% + fixed-order stabilization (HIFOO best of 16) CPU 15.3 s | median regret 50.75% + C-only generator 16 + 1 optimizer start CPU 1565.3 s | median regret 2.60% + C+phi generator 16 + 1 optimizer start CPU 1566.4 s | median regret 0.01% + [38] C-only: F-only optimizer reaches the generator's 6.79% at 8 starts, 1582 s against 11.5 s: ratio 138x + [38] C+phi: joint optimizer reaches the generator's 7.14% at 2 starts, 3084 s against 29.1 s: ratio 106x + C-only kNN (retrieval + scoring, 16) 9.5 s; twin (sampling + scoring, 16) 1.9 s + C+phi kNN (retrieval + scoring, 16) 7.6 s; twin (sampling + scoring, 16) 17.2 s diff --git a/results/icml_r3/X29/siso/timing/plant_000_fopt1.json b/results/icml_r3/X29/siso/timing/plant_000_fopt1.json new file mode 100644 index 0000000000000000000000000000000000000000..13faf9530dc9fc570b48e2480d66546f43e7450a --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_000_fopt1.json @@ -0,0 +1 @@ +{"i": 0, "method": "fopt1", "t": 1610.2393736839294, "k": 1, "load": [6.0107421875, 6.0, 5.39453125]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_000_fopt16.json b/results/icml_r3/X29/siso/timing/plant_000_fopt16.json new file mode 100644 index 0000000000000000000000000000000000000000..c1d8b2f989aa4d1bbf9fdfea3e4323cf066c7f2f --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_000_fopt16.json @@ -0,0 +1 @@ +{"i": 0, "method": "fopt16", "t": 1693.0486862659454, "k": 16, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_000_fopt4.json b/results/icml_r3/X29/siso/timing/plant_000_fopt4.json new file mode 100644 index 0000000000000000000000000000000000000000..b0723a29b0e0366ec5ed7b947a7cfbf01c7a8840 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_000_fopt4.json @@ -0,0 +1 @@ +{"i": 0, "method": "fopt4", "t": 1529.6605348587036, "k": 4, "load": [6.0, 6.0, 5.9189453125]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_000_gen_C+phi.json b/results/icml_r3/X29/siso/timing/plant_000_gen_C+phi.json new file mode 100644 index 0000000000000000000000000000000000000000..f8946d8a9f4609725a63f7444ce2c60df1e568e6 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_000_gen_C+phi.json @@ -0,0 +1 @@ +{"i": 0, "method": "gen_C+phi", "t_sample": 8.641952991485596, "t_score": 20.20849061012268, "t": 28.850443601608276, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_000_gen_C-only.json b/results/icml_r3/X29/siso/timing/plant_000_gen_C-only.json new file mode 100644 index 0000000000000000000000000000000000000000..82c6289952c37b0a0d3ccc9ad4fc46b4219aeb15 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_000_gen_C-only.json @@ -0,0 +1 @@ +{"i": 0, "method": "gen_C-only", "t_sample": 8.723515272140503, "t_score": 1.421351671218872, "t": 10.144866943359375, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_000_hifoo2.json b/results/icml_r3/X29/siso/timing/plant_000_hifoo2.json new file mode 100644 index 0000000000000000000000000000000000000000..d52fe100531bd8fcbb015e108aca4f3fb2770ef9 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_000_hifoo2.json @@ -0,0 +1 @@ +{"i": 0, "method": "hifoo2", "t": 7.0185874700546265, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_000_jopt1.json b/results/icml_r3/X29/siso/timing/plant_000_jopt1.json new file mode 100644 index 0000000000000000000000000000000000000000..fa29749b08997aa110e2e0bbbd3d87f58bb816d0 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_000_jopt1.json @@ -0,0 +1 @@ +{"i": 0, "method": "jopt1", "t": 1479.6743664741516, "k": 1, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_000_jopt16.json b/results/icml_r3/X29/siso/timing/plant_000_jopt16.json new file mode 100644 index 0000000000000000000000000000000000000000..d872982e4433b8cad3eef5601c16c21662d5e8fd --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_000_jopt16.json @@ -0,0 +1 @@ +{"i": 0, "method": "jopt16", "t": 1720.920538187027, "k": 16, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_000_jopt4.json b/results/icml_r3/X29/siso/timing/plant_000_jopt4.json new file mode 100644 index 0000000000000000000000000000000000000000..cd0e88df4112ebb52ef69d46621e5269597e9e12 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_000_jopt4.json @@ -0,0 +1 @@ +{"i": 0, "method": "jopt4", "t": 1511.4163365364075, "k": 4, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_000_knn_C+phi.json b/results/icml_r3/X29/siso/timing/plant_000_knn_C+phi.json new file mode 100644 index 0000000000000000000000000000000000000000..30596d1433f6d0d8bbc638708d52484568bcde12 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_000_knn_C+phi.json @@ -0,0 +1 @@ +{"i": 0, "method": "knn_C+phi", "t_sample": 0.005944490432739258, "t_score": 7.443649768829346, "t": 7.449594259262085, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_000_knn_C-only.json b/results/icml_r3/X29/siso/timing/plant_000_knn_C-only.json new file mode 100644 index 0000000000000000000000000000000000000000..e33295f6f9476cd419729162bda3f5fed3df79e5 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_000_knn_C-only.json @@ -0,0 +1 @@ +{"i": 0, "method": "knn_C-only", "t_sample": 2.10442852973938, "t_score": 1.0252888202667236, "t": 3.1297173500061035, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_000_twin_C+phi.json b/results/icml_r3/X29/siso/timing/plant_000_twin_C+phi.json new file mode 100644 index 0000000000000000000000000000000000000000..7b87766b2b6c21c065f7826a6d38447e31e24b3e --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_000_twin_C+phi.json @@ -0,0 +1 @@ +{"i": 0, "method": "twin_C+phi", "t_sample": 0.23180317878723145, "t_score": 0.18750786781311035, "t": 0.4193110466003418, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_000_twin_C-only.json b/results/icml_r3/X29/siso/timing/plant_000_twin_C-only.json new file mode 100644 index 0000000000000000000000000000000000000000..c8c4b1e3197c16b1c11572c70ca13f27222adaef --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_000_twin_C-only.json @@ -0,0 +1 @@ +{"i": 0, "method": "twin_C-only", "t_sample": 0.25113391876220703, "t_score": 0.08510637283325195, "t": 0.336240291595459, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_021_fopt1.json b/results/icml_r3/X29/siso/timing/plant_021_fopt1.json new file mode 100644 index 0000000000000000000000000000000000000000..ba32e62443f83556e614c35642f40728e4e6f356 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_021_fopt1.json @@ -0,0 +1 @@ +{"i": 21, "method": "fopt1", "t": 1603.8419466018677, "k": 1, "load": [6.0, 6.0, 5.9150390625]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_021_fopt16.json b/results/icml_r3/X29/siso/timing/plant_021_fopt16.json new file mode 100644 index 0000000000000000000000000000000000000000..71e8141475505098fc74d5159652df22d2900ffa --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_021_fopt16.json @@ -0,0 +1 @@ +{"i": 21, "method": "fopt16", "t": 1609.1883926391602, "k": 16, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_021_fopt4.json b/results/icml_r3/X29/siso/timing/plant_021_fopt4.json new file mode 100644 index 0000000000000000000000000000000000000000..37f6e58657322cad69fae4ee90ffc229860e3071 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_021_fopt4.json @@ -0,0 +1 @@ +{"i": 21, "method": "fopt4", "t": 1512.834814786911, "k": 4, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_021_gen_C+phi.json b/results/icml_r3/X29/siso/timing/plant_021_gen_C+phi.json new file mode 100644 index 0000000000000000000000000000000000000000..ad2fcdeb641702c5c00e349af09a35d651a8e527 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_021_gen_C+phi.json @@ -0,0 +1 @@ +{"i": 21, "method": "gen_C+phi", "t_sample": 8.728589296340942, "t_score": 21.289788722991943, "t": 30.018378019332886, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_021_gen_C-only.json b/results/icml_r3/X29/siso/timing/plant_021_gen_C-only.json new file mode 100644 index 0000000000000000000000000000000000000000..de1f64b1ca242f729c932109dc0e985513112801 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_021_gen_C-only.json @@ -0,0 +1 @@ +{"i": 21, "method": "gen_C-only", "t_sample": 8.670607328414917, "t_score": 3.4282965660095215, "t": 12.098903894424438, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_021_hifoo2.json b/results/icml_r3/X29/siso/timing/plant_021_hifoo2.json new file mode 100644 index 0000000000000000000000000000000000000000..fd931440f731519f24c5b1f716113f429ecb0ee0 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_021_hifoo2.json @@ -0,0 +1 @@ +{"i": 21, "method": "hifoo2", "t": 0.7439807653427124, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_021_jopt1.json b/results/icml_r3/X29/siso/timing/plant_021_jopt1.json new file mode 100644 index 0000000000000000000000000000000000000000..c232fbeacb2e85a2edf6a7761708db3bdb1a4d56 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_021_jopt1.json @@ -0,0 +1 @@ +{"i": 21, "method": "jopt1", "t": 1616.4610531330109, "k": 1, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_021_jopt16.json b/results/icml_r3/X29/siso/timing/plant_021_jopt16.json new file mode 100644 index 0000000000000000000000000000000000000000..c354f7f7a3eb6b8c0782c9fc46286f18def05d58 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_021_jopt16.json @@ -0,0 +1 @@ +{"i": 21, "method": "jopt16", "t": 1778.183555841446, "k": 16, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_021_jopt4.json b/results/icml_r3/X29/siso/timing/plant_021_jopt4.json new file mode 100644 index 0000000000000000000000000000000000000000..50377e920b3fd8afd70a25c97af53a88651a15db --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_021_jopt4.json @@ -0,0 +1 @@ +{"i": 21, "method": "jopt4", "t": 1580.9241681098938, "k": 4, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_021_knn_C+phi.json b/results/icml_r3/X29/siso/timing/plant_021_knn_C+phi.json new file mode 100644 index 0000000000000000000000000000000000000000..371dcb7ca7cbb69a76ef0b2fe9edbe656a220a76 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_021_knn_C+phi.json @@ -0,0 +1 @@ +{"i": 21, "method": "knn_C+phi", "t_sample": 0.005930423736572266, "t_score": 0.9871442317962646, "t": 0.9930746555328369, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_021_knn_C-only.json b/results/icml_r3/X29/siso/timing/plant_021_knn_C-only.json new file mode 100644 index 0000000000000000000000000000000000000000..c5035a7d7a3be25ada12e7427fd25fe9b8a87e8b --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_021_knn_C-only.json @@ -0,0 +1 @@ +{"i": 21, "method": "knn_C-only", "t_sample": 2.1155502796173096, "t_score": 1.1700952053070068, "t": 3.2856454849243164, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_021_twin_C+phi.json b/results/icml_r3/X29/siso/timing/plant_021_twin_C+phi.json new file mode 100644 index 0000000000000000000000000000000000000000..97f3f571912f11a1168ccaca5737447a334b152c --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_021_twin_C+phi.json @@ -0,0 +1 @@ +{"i": 21, "method": "twin_C+phi", "t_sample": 0.2300739288330078, "t_score": 0.22470903396606445, "t": 0.45478296279907227, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_021_twin_C-only.json b/results/icml_r3/X29/siso/timing/plant_021_twin_C-only.json new file mode 100644 index 0000000000000000000000000000000000000000..08191824959329359c60f097c5375d03305ff610 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_021_twin_C-only.json @@ -0,0 +1 @@ +{"i": 21, "method": "twin_C-only", "t_sample": 0.22515177726745605, "t_score": 0.26130175590515137, "t": 0.4864535331726074, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_041_fopt1.json b/results/icml_r3/X29/siso/timing/plant_041_fopt1.json new file mode 100644 index 0000000000000000000000000000000000000000..146728fb9ecbddf3ddf6766ed80dea11ed08d782 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_041_fopt1.json @@ -0,0 +1 @@ +{"i": 41, "method": "fopt1", "t": 1533.378296136856, "k": 1, "load": [6.0, 6.0, 5.9150390625]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_041_fopt16.json b/results/icml_r3/X29/siso/timing/plant_041_fopt16.json new file mode 100644 index 0000000000000000000000000000000000000000..8c9770b83cdd0ee9c46eb35a78fbfe71c72d82ca --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_041_fopt16.json @@ -0,0 +1 @@ +{"i": 41, "method": "fopt16", "t": 1787.9273924827576, "k": 16, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_041_fopt4.json b/results/icml_r3/X29/siso/timing/plant_041_fopt4.json new file mode 100644 index 0000000000000000000000000000000000000000..5b44958d0428504af7f808fa125cd12134cc321c --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_041_fopt4.json @@ -0,0 +1 @@ +{"i": 41, "method": "fopt4", "t": 1572.8095934391022, "k": 4, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_041_gen_C+phi.json b/results/icml_r3/X29/siso/timing/plant_041_gen_C+phi.json new file mode 100644 index 0000000000000000000000000000000000000000..7994ceeaf6d18d96e1700c486483e11afcd861c6 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_041_gen_C+phi.json @@ -0,0 +1 @@ +{"i": 41, "method": "gen_C+phi", "t_sample": 8.899398565292358, "t_score": 1.698326826095581, "t": 10.59772539138794, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_041_gen_C-only.json b/results/icml_r3/X29/siso/timing/plant_041_gen_C-only.json new file mode 100644 index 0000000000000000000000000000000000000000..a15c43089815bf209580b10d902d54382f29b001 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_041_gen_C-only.json @@ -0,0 +1 @@ +{"i": 41, "method": "gen_C-only", "t_sample": 8.66327452659607, "t_score": 1.2682888507843018, "t": 9.931563377380371, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_041_hifoo2.json b/results/icml_r3/X29/siso/timing/plant_041_hifoo2.json new file mode 100644 index 0000000000000000000000000000000000000000..ee470121809396eaf9e68ae56bf18c32144ef457 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_041_hifoo2.json @@ -0,0 +1 @@ +{"i": 41, "method": "hifoo2", "t": 1.9034154415130615, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_041_jopt1.json b/results/icml_r3/X29/siso/timing/plant_041_jopt1.json new file mode 100644 index 0000000000000000000000000000000000000000..257d5a06a408353de9b1f3287f1dc664237c1a0e --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_041_jopt1.json @@ -0,0 +1 @@ +{"i": 41, "method": "jopt1", "t": 1552.531121969223, "k": 1, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_041_jopt16.json b/results/icml_r3/X29/siso/timing/plant_041_jopt16.json new file mode 100644 index 0000000000000000000000000000000000000000..37f0868c63aaf9e2e2ba0b13ffedacf176f35d3c --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_041_jopt16.json @@ -0,0 +1 @@ +{"i": 41, "method": "jopt16", "t": 1799.8491704463959, "k": 16, "load": [3.51025390625, 5.095703125, 5.66943359375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_041_jopt4.json b/results/icml_r3/X29/siso/timing/plant_041_jopt4.json new file mode 100644 index 0000000000000000000000000000000000000000..24e72a0aac165c0da4b262f65d2be60e0efdaef5 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_041_jopt4.json @@ -0,0 +1 @@ +{"i": 41, "method": "jopt4", "t": 1499.8948347568512, "k": 4, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_041_knn_C+phi.json b/results/icml_r3/X29/siso/timing/plant_041_knn_C+phi.json new file mode 100644 index 0000000000000000000000000000000000000000..8b82ba306cd7f19588d09f3c42d1c72af9d03ba0 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_041_knn_C+phi.json @@ -0,0 +1 @@ +{"i": 41, "method": "knn_C+phi", "t_sample": 0.005980730056762695, "t_score": 0.11679935455322266, "t": 0.12278008460998535, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_041_knn_C-only.json b/results/icml_r3/X29/siso/timing/plant_041_knn_C-only.json new file mode 100644 index 0000000000000000000000000000000000000000..104267238ecf456dc1b3a4333b86b4b10cc1469c --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_041_knn_C-only.json @@ -0,0 +1 @@ +{"i": 41, "method": "knn_C-only", "t_sample": 2.1139070987701416, "t_score": 0.5942299365997314, "t": 2.708137035369873, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_041_twin_C+phi.json b/results/icml_r3/X29/siso/timing/plant_041_twin_C+phi.json new file mode 100644 index 0000000000000000000000000000000000000000..76ebd655682557476f3e822f9d001c85b4c6857b --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_041_twin_C+phi.json @@ -0,0 +1 @@ +{"i": 41, "method": "twin_C+phi", "t_sample": 0.20940399169921875, "t_score": 1.5725376605987549, "t": 1.7819416522979736, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_041_twin_C-only.json b/results/icml_r3/X29/siso/timing/plant_041_twin_C-only.json new file mode 100644 index 0000000000000000000000000000000000000000..6edadea779a5af45bbbcc564c060ef42ded151be --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_041_twin_C-only.json @@ -0,0 +1 @@ +{"i": 41, "method": "twin_C-only", "t_sample": 0.1909935474395752, "t_score": 8.11414384841919, "t": 8.305137395858765, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_061_fopt1.json b/results/icml_r3/X29/siso/timing/plant_061_fopt1.json new file mode 100644 index 0000000000000000000000000000000000000000..7401fead35756c6af1a404a3495b9e0927e2dca4 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_061_fopt1.json @@ -0,0 +1 @@ +{"i": 61, "method": "fopt1", "t": 1546.6886041164398, "k": 1, "load": [6.0, 6.0, 5.9150390625]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_061_fopt16.json b/results/icml_r3/X29/siso/timing/plant_061_fopt16.json new file mode 100644 index 0000000000000000000000000000000000000000..55290b0edc9fb15d7689c6bfbc37b79e860cd80b --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_061_fopt16.json @@ -0,0 +1 @@ +{"i": 61, "method": "fopt16", "t": 1680.0087144374847, "k": 16, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_061_fopt4.json b/results/icml_r3/X29/siso/timing/plant_061_fopt4.json new file mode 100644 index 0000000000000000000000000000000000000000..522cd0677ce3990741c76a5930cc43563c829f51 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_061_fopt4.json @@ -0,0 +1 @@ +{"i": 61, "method": "fopt4", "t": 1523.4473977088928, "k": 4, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_061_gen_C+phi.json b/results/icml_r3/X29/siso/timing/plant_061_gen_C+phi.json new file mode 100644 index 0000000000000000000000000000000000000000..bc6b76a2a83b7f1cd1c147ca51b18310ed1b164d --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_061_gen_C+phi.json @@ -0,0 +1 @@ +{"i": 61, "method": "gen_C+phi", "t_sample": 8.816847324371338, "t_score": 101.55113768577576, "t": 110.3679850101471, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_061_gen_C-only.json b/results/icml_r3/X29/siso/timing/plant_061_gen_C-only.json new file mode 100644 index 0000000000000000000000000000000000000000..82fbd299e678166b9e7ee403412300a8fc8051ba --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_061_gen_C-only.json @@ -0,0 +1 @@ +{"i": 61, "method": "gen_C-only", "t_sample": 8.775710821151733, "t_score": 20.96033549308777, "t": 29.736046314239502, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_061_hifoo2.json b/results/icml_r3/X29/siso/timing/plant_061_hifoo2.json new file mode 100644 index 0000000000000000000000000000000000000000..f27753b09aa6f13eb6b8a68bf045e0af13147b49 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_061_hifoo2.json @@ -0,0 +1 @@ +{"i": 61, "method": "hifoo2", "t": 3.89178729057312, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_061_jopt1.json b/results/icml_r3/X29/siso/timing/plant_061_jopt1.json new file mode 100644 index 0000000000000000000000000000000000000000..7704277ac839f9c4b706374b061bde6895cd61e8 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_061_jopt1.json @@ -0,0 +1 @@ +{"i": 61, "method": "jopt1", "t": 1465.6780953407288, "k": 1, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_061_jopt16.json b/results/icml_r3/X29/siso/timing/plant_061_jopt16.json new file mode 100644 index 0000000000000000000000000000000000000000..4226d70ecc3cb088fba151137eecba9df7e1408a --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_061_jopt16.json @@ -0,0 +1 @@ +{"i": 61, "method": "jopt16", "t": 1792.289059638977, "k": 16, "load": [2.07861328125, 3.71630859375, 5.03125]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_061_jopt4.json b/results/icml_r3/X29/siso/timing/plant_061_jopt4.json new file mode 100644 index 0000000000000000000000000000000000000000..b1bb5100b66fc0cc48515230beb379f39565b62e --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_061_jopt4.json @@ -0,0 +1 @@ +{"i": 61, "method": "jopt4", "t": 1662.5108153820038, "k": 4, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_061_knn_C+phi.json b/results/icml_r3/X29/siso/timing/plant_061_knn_C+phi.json new file mode 100644 index 0000000000000000000000000000000000000000..bdec632bf4ee647cfc4994507e93e86dd9d03cac --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_061_knn_C+phi.json @@ -0,0 +1 @@ +{"i": 61, "method": "knn_C+phi", "t_sample": 0.005631923675537109, "t_score": 81.03052234649658, "t": 81.03615427017212, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_061_knn_C-only.json b/results/icml_r3/X29/siso/timing/plant_061_knn_C-only.json new file mode 100644 index 0000000000000000000000000000000000000000..822b3783f484865fd4199d5ba1b01686bab89b6e --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_061_knn_C-only.json @@ -0,0 +1 @@ +{"i": 61, "method": "knn_C-only", "t_sample": 2.110363483428955, "t_score": 21.480818033218384, "t": 23.59118151664734, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_061_twin_C+phi.json b/results/icml_r3/X29/siso/timing/plant_061_twin_C+phi.json new file mode 100644 index 0000000000000000000000000000000000000000..d603c8a76c44fc4d32c62be8762249883c071dad --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_061_twin_C+phi.json @@ -0,0 +1 @@ +{"i": 61, "method": "twin_C+phi", "t_sample": 0.22490644454956055, "t_score": 64.12049555778503, "t": 64.3454020023346, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_061_twin_C-only.json b/results/icml_r3/X29/siso/timing/plant_061_twin_C-only.json new file mode 100644 index 0000000000000000000000000000000000000000..04a0dd1ec1d91a91c43be2e773f618b70d2d5a80 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_061_twin_C-only.json @@ -0,0 +1 @@ +{"i": 61, "method": "twin_C-only", "t_sample": 0.22717928886413574, "t_score": 70.92502117156982, "t": 71.15220046043396, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_081_fopt1.json b/results/icml_r3/X29/siso/timing/plant_081_fopt1.json new file mode 100644 index 0000000000000000000000000000000000000000..793daacfb01be793008bbd70e8d3a7e1d4db9f0d --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_081_fopt1.json @@ -0,0 +1 @@ +{"i": 81, "method": "fopt1", "t": 1560.9247832298279, "k": 1, "load": [6.0, 6.0, 5.9189453125]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_081_fopt16.json b/results/icml_r3/X29/siso/timing/plant_081_fopt16.json new file mode 100644 index 0000000000000000000000000000000000000000..435ba5a8f609a4d4884488323b5ed904426ac545 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_081_fopt16.json @@ -0,0 +1 @@ +{"i": 81, "method": "fopt16", "t": 1678.8860318660736, "k": 15, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_081_fopt4.json b/results/icml_r3/X29/siso/timing/plant_081_fopt4.json new file mode 100644 index 0000000000000000000000000000000000000000..e56d0a407cf5fc55ef0ad2c1cda46317ea14a374 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_081_fopt4.json @@ -0,0 +1 @@ +{"i": 81, "method": "fopt4", "t": 1470.7311625480652, "k": 4, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_081_gen_C+phi.json b/results/icml_r3/X29/siso/timing/plant_081_gen_C+phi.json new file mode 100644 index 0000000000000000000000000000000000000000..81ff6f33d8b55a3d8aad07284cf2bdfdf9cf9795 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_081_gen_C+phi.json @@ -0,0 +1 @@ +{"i": 81, "method": "gen_C+phi", "t_sample": 9.0640549659729, "t_score": 45.90264630317688, "t": 54.96670126914978, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_081_gen_C-only.json b/results/icml_r3/X29/siso/timing/plant_081_gen_C-only.json new file mode 100644 index 0000000000000000000000000000000000000000..a5e343beeffb0d4ab78039bfebd49a8b2bc90a31 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_081_gen_C-only.json @@ -0,0 +1 @@ +{"i": 81, "method": "gen_C-only", "t_sample": 8.617351055145264, "t_score": 2.2555251121520996, "t": 10.872876167297363, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_081_hifoo2.json b/results/icml_r3/X29/siso/timing/plant_081_hifoo2.json new file mode 100644 index 0000000000000000000000000000000000000000..5a0dfd30ee86a0603ad906c61b2a4655fa8e2771 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_081_hifoo2.json @@ -0,0 +1 @@ +{"i": 81, "method": "hifoo2", "t": 3.5446102619171143, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_081_jopt1.json b/results/icml_r3/X29/siso/timing/plant_081_jopt1.json new file mode 100644 index 0000000000000000000000000000000000000000..1288541b5217a7576833c5fed42bed729b1172fa --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_081_jopt1.json @@ -0,0 +1 @@ +{"i": 81, "method": "jopt1", "t": 1577.6137218475342, "k": 1, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_081_jopt16.json b/results/icml_r3/X29/siso/timing/plant_081_jopt16.json new file mode 100644 index 0000000000000000000000000000000000000000..4a100f3a08190bc274786439d646bb0a70ed4342 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_081_jopt16.json @@ -0,0 +1 @@ +{"i": 81, "method": "jopt16", "t": 1940.383662700653, "k": 15, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_081_jopt4.json b/results/icml_r3/X29/siso/timing/plant_081_jopt4.json new file mode 100644 index 0000000000000000000000000000000000000000..b2933ff6ed56b6e3d4e3b40f961d816a46743673 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_081_jopt4.json @@ -0,0 +1 @@ +{"i": 81, "method": "jopt4", "t": 1568.4061996936798, "k": 4, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_081_knn_C+phi.json b/results/icml_r3/X29/siso/timing/plant_081_knn_C+phi.json new file mode 100644 index 0000000000000000000000000000000000000000..2b5ba2c488c6fca5be735ac9aeac4091bbb2a7c1 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_081_knn_C+phi.json @@ -0,0 +1 @@ +{"i": 81, "method": "knn_C+phi", "t_sample": 0.0057790279388427734, "t_score": 23.047688007354736, "t": 23.05346703529358, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_081_knn_C-only.json b/results/icml_r3/X29/siso/timing/plant_081_knn_C-only.json new file mode 100644 index 0000000000000000000000000000000000000000..c5630ceb2e91c24d47128b30d1378e0d5f9b6bdb --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_081_knn_C-only.json @@ -0,0 +1 @@ +{"i": 81, "method": "knn_C-only", "t_sample": 2.0889012813568115, "t_score": 15.053784132003784, "t": 17.142685413360596, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_081_twin_C+phi.json b/results/icml_r3/X29/siso/timing/plant_081_twin_C+phi.json new file mode 100644 index 0000000000000000000000000000000000000000..94373122eba3a44c4dee332996699fefcaa362c2 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_081_twin_C+phi.json @@ -0,0 +1 @@ +{"i": 81, "method": "twin_C+phi", "t_sample": 0.22002935409545898, "t_score": 38.96049785614014, "t": 39.180527210235596, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_081_twin_C-only.json b/results/icml_r3/X29/siso/timing/plant_081_twin_C-only.json new file mode 100644 index 0000000000000000000000000000000000000000..1eccbbb7d6aa1bf4da441d6dbd1f8a427ccc5a63 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_081_twin_C-only.json @@ -0,0 +1 @@ +{"i": 81, "method": "twin_C-only", "t_sample": 0.2305164337158203, "t_score": 2.2534220218658447, "t": 2.483938455581665, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_109_fopt1.json b/results/icml_r3/X29/siso/timing/plant_109_fopt1.json new file mode 100644 index 0000000000000000000000000000000000000000..117fb8dde9120bbcff5e68138f3faa801f56a2ac --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_109_fopt1.json @@ -0,0 +1 @@ +{"i": 109, "method": "fopt1", "t": 1582.7828950881958, "k": 1, "load": [6.0107421875, 6.0, 5.39453125]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_109_fopt16.json b/results/icml_r3/X29/siso/timing/plant_109_fopt16.json new file mode 100644 index 0000000000000000000000000000000000000000..8c427fe52004e46d2a1db2a2058b62a3bd6b199f --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_109_fopt16.json @@ -0,0 +1 @@ +{"i": 109, "method": "fopt16", "t": 1632.5185837745667, "k": 16, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_109_fopt4.json b/results/icml_r3/X29/siso/timing/plant_109_fopt4.json new file mode 100644 index 0000000000000000000000000000000000000000..985b251f363e129b4a8dc0e693bf23b6b266c703 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_109_fopt4.json @@ -0,0 +1 @@ +{"i": 109, "method": "fopt4", "t": 1504.6020810604095, "k": 4, "load": [6.0, 6.0, 5.9189453125]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_109_gen_C+phi.json b/results/icml_r3/X29/siso/timing/plant_109_gen_C+phi.json new file mode 100644 index 0000000000000000000000000000000000000000..8c3b0a1ab86710422eed366027a7cdaf134959b2 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_109_gen_C+phi.json @@ -0,0 +1 @@ +{"i": 109, "method": "gen_C+phi", "t_sample": 8.659764766693115, "t_score": 20.319529056549072, "t": 28.979293823242188, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_109_gen_C-only.json b/results/icml_r3/X29/siso/timing/plant_109_gen_C-only.json new file mode 100644 index 0000000000000000000000000000000000000000..b71b80c97e0762842c9823dafa3302903dd23de9 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_109_gen_C-only.json @@ -0,0 +1 @@ +{"i": 109, "method": "gen_C-only", "t_sample": 8.898682117462158, "t_score": 7.365377187728882, "t": 16.26405930519104, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_109_hifoo2.json b/results/icml_r3/X29/siso/timing/plant_109_hifoo2.json new file mode 100644 index 0000000000000000000000000000000000000000..c46148a1b13fa65f7e27d6ec39fddb81858ab7d2 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_109_hifoo2.json @@ -0,0 +1 @@ +{"i": 109, "method": "hifoo2", "t": 0.17662334442138672, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_109_jopt1.json b/results/icml_r3/X29/siso/timing/plant_109_jopt1.json new file mode 100644 index 0000000000000000000000000000000000000000..7996db5ddd1a477d3acb25382058d013ca66fc00 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_109_jopt1.json @@ -0,0 +1 @@ +{"i": 109, "method": "jopt1", "t": 1522.0688178539276, "k": 1, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_109_jopt16.json b/results/icml_r3/X29/siso/timing/plant_109_jopt16.json new file mode 100644 index 0000000000000000000000000000000000000000..71c47699ee37725dc641e2ca7cd1ac5af6d718c1 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_109_jopt16.json @@ -0,0 +1 @@ +{"i": 109, "method": "jopt16", "t": 1626.0894248485565, "k": 16, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_109_jopt4.json b/results/icml_r3/X29/siso/timing/plant_109_jopt4.json new file mode 100644 index 0000000000000000000000000000000000000000..2a157a745b126707945aff3e313094eea0e9c4fd --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_109_jopt4.json @@ -0,0 +1 @@ +{"i": 109, "method": "jopt4", "t": 1522.981523513794, "k": 4, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_109_knn_C+phi.json b/results/icml_r3/X29/siso/timing/plant_109_knn_C+phi.json new file mode 100644 index 0000000000000000000000000000000000000000..68ea34f25a67340c36c17bb44a1a9e31f97d212a --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_109_knn_C+phi.json @@ -0,0 +1 @@ +{"i": 109, "method": "knn_C+phi", "t_sample": 0.006016731262207031, "t_score": 1.2480547428131104, "t": 1.2540714740753174, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_109_knn_C-only.json b/results/icml_r3/X29/siso/timing/plant_109_knn_C-only.json new file mode 100644 index 0000000000000000000000000000000000000000..4a9d84758ff357fac93a3172b2d49477a5c9e188 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_109_knn_C-only.json @@ -0,0 +1 @@ +{"i": 109, "method": "knn_C-only", "t_sample": 2.111675500869751, "t_score": 7.244135856628418, "t": 9.355811357498169, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_109_twin_C+phi.json b/results/icml_r3/X29/siso/timing/plant_109_twin_C+phi.json new file mode 100644 index 0000000000000000000000000000000000000000..fd510b846db99f7d847ee10fefde9524a8e33050 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_109_twin_C+phi.json @@ -0,0 +1 @@ +{"i": 109, "method": "twin_C+phi", "t_sample": 0.23086309432983398, "t_score": 26.94709277153015, "t": 27.177955865859985, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_109_twin_C-only.json b/results/icml_r3/X29/siso/timing/plant_109_twin_C-only.json new file mode 100644 index 0000000000000000000000000000000000000000..82e7a3f1ea459174bc63cda96157a3c345178ee8 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_109_twin_C-only.json @@ -0,0 +1 @@ +{"i": 109, "method": "twin_C-only", "t_sample": 0.18903255462646484, "t_score": 1.885802984237671, "t": 2.0748355388641357, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_128_fopt1.json b/results/icml_r3/X29/siso/timing/plant_128_fopt1.json new file mode 100644 index 0000000000000000000000000000000000000000..b65c1ead054dd0918499b220180bc1c21bb97155 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_128_fopt1.json @@ -0,0 +1 @@ +{"i": 128, "method": "fopt1", "t": 1525.9311907291412, "k": 1, "load": [6.0107421875, 6.0, 5.39453125]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_128_fopt16.json b/results/icml_r3/X29/siso/timing/plant_128_fopt16.json new file mode 100644 index 0000000000000000000000000000000000000000..7bfb411bf9ca863831da4cd8b5d3a5e169919c70 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_128_fopt16.json @@ -0,0 +1 @@ +{"i": 128, "method": "fopt16", "t": 1744.028868675232, "k": 16, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_128_fopt4.json b/results/icml_r3/X29/siso/timing/plant_128_fopt4.json new file mode 100644 index 0000000000000000000000000000000000000000..3c4db68c7693178e878895d42fb53d9b9445d404 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_128_fopt4.json @@ -0,0 +1 @@ +{"i": 128, "method": "fopt4", "t": 1490.6085059642792, "k": 4, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_128_gen_C+phi.json b/results/icml_r3/X29/siso/timing/plant_128_gen_C+phi.json new file mode 100644 index 0000000000000000000000000000000000000000..eff6c4c37165e88e61525859dc293de25e524f01 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_128_gen_C+phi.json @@ -0,0 +1 @@ +{"i": 128, "method": "gen_C+phi", "t_sample": 8.630990028381348, "t_score": 1.5123116970062256, "t": 10.143301725387573, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_128_gen_C-only.json b/results/icml_r3/X29/siso/timing/plant_128_gen_C-only.json new file mode 100644 index 0000000000000000000000000000000000000000..7e9ba2ef1e82cd4a5aaec5550da56a1302de223d --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_128_gen_C-only.json @@ -0,0 +1 @@ +{"i": 128, "method": "gen_C-only", "t_sample": 8.721668004989624, "t_score": 20.2502760887146, "t": 28.971944093704224, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_128_hifoo2.json b/results/icml_r3/X29/siso/timing/plant_128_hifoo2.json new file mode 100644 index 0000000000000000000000000000000000000000..e852b5a568e3f2bf37e1f56ded7f9b43806e0086 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_128_hifoo2.json @@ -0,0 +1 @@ +{"i": 128, "method": "hifoo2", "t": 0.4424905776977539, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_128_jopt1.json b/results/icml_r3/X29/siso/timing/plant_128_jopt1.json new file mode 100644 index 0000000000000000000000000000000000000000..6f7900e0e5adb96b4f703f7f207231eb78e15f86 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_128_jopt1.json @@ -0,0 +1 @@ +{"i": 128, "method": "jopt1", "t": 1473.6608180999756, "k": 1, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_128_jopt16.json b/results/icml_r3/X29/siso/timing/plant_128_jopt16.json new file mode 100644 index 0000000000000000000000000000000000000000..f3113f18fca7a132c986c2cb0bea57ac0d45b1c2 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_128_jopt16.json @@ -0,0 +1 @@ +{"i": 128, "method": "jopt16", "t": 1865.1839694976807, "k": 16, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_128_jopt4.json b/results/icml_r3/X29/siso/timing/plant_128_jopt4.json new file mode 100644 index 0000000000000000000000000000000000000000..91a2993c23990f26e39286bb806deba92824bf8f --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_128_jopt4.json @@ -0,0 +1 @@ +{"i": 128, "method": "jopt4", "t": 1572.0292465686798, "k": 4, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_128_knn_C+phi.json b/results/icml_r3/X29/siso/timing/plant_128_knn_C+phi.json new file mode 100644 index 0000000000000000000000000000000000000000..047c13811d71678804fd0425c7bad84b39b310b2 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_128_knn_C+phi.json @@ -0,0 +1 @@ +{"i": 128, "method": "knn_C+phi", "t_sample": 0.005996227264404297, "t_score": 7.6983802318573, "t": 7.704376459121704, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_128_knn_C-only.json b/results/icml_r3/X29/siso/timing/plant_128_knn_C-only.json new file mode 100644 index 0000000000000000000000000000000000000000..e5539f9ce0a12915ab788e481438d3940164aa2c --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_128_knn_C-only.json @@ -0,0 +1 @@ +{"i": 128, "method": "knn_C-only", "t_sample": 2.1309001445770264, "t_score": 7.555644273757935, "t": 9.686544418334961, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_128_twin_C+phi.json b/results/icml_r3/X29/siso/timing/plant_128_twin_C+phi.json new file mode 100644 index 0000000000000000000000000000000000000000..d20b3183b9ea3c5679184c1f52dde3e2cf55c8b3 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_128_twin_C+phi.json @@ -0,0 +1 @@ +{"i": 128, "method": "twin_C+phi", "t_sample": 0.23521065711975098, "t_score": 26.557109594345093, "t": 26.792320251464844, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_128_twin_C-only.json b/results/icml_r3/X29/siso/timing/plant_128_twin_C-only.json new file mode 100644 index 0000000000000000000000000000000000000000..d08b7d615434053e7b5136daa03d8285befdd454 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_128_twin_C-only.json @@ -0,0 +1 @@ +{"i": 128, "method": "twin_C-only", "t_sample": 0.20006752014160156, "t_score": 1.5296988487243652, "t": 1.7297663688659668, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_146_fopt1.json b/results/icml_r3/X29/siso/timing/plant_146_fopt1.json new file mode 100644 index 0000000000000000000000000000000000000000..7e5e38580b947ba484dea6e893a7b3935a43dd9d --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_146_fopt1.json @@ -0,0 +1 @@ +{"i": 146, "method": "fopt1", "t": 1523.0870213508606, "k": 1, "load": [6.0107421875, 6.0, 5.39453125]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_146_fopt16.json b/results/icml_r3/X29/siso/timing/plant_146_fopt16.json new file mode 100644 index 0000000000000000000000000000000000000000..fab0978c15049e8ad3e2ec08faa49c8820fe7233 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_146_fopt16.json @@ -0,0 +1 @@ +{"i": 146, "method": "fopt16", "t": 1704.1061341762543, "k": 16, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_146_fopt4.json b/results/icml_r3/X29/siso/timing/plant_146_fopt4.json new file mode 100644 index 0000000000000000000000000000000000000000..6232a1c2c9585e6846080b4b2beea7ff166246bc --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_146_fopt4.json @@ -0,0 +1 @@ +{"i": 146, "method": "fopt4", "t": 1627.699233531952, "k": 4, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_146_gen_C+phi.json b/results/icml_r3/X29/siso/timing/plant_146_gen_C+phi.json new file mode 100644 index 0000000000000000000000000000000000000000..4d9eb1d6da82daa4a87b8ba4ac7081e5588a58a6 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_146_gen_C+phi.json @@ -0,0 +1 @@ +{"i": 146, "method": "gen_C+phi", "t_sample": 8.61212158203125, "t_score": 7.705474615097046, "t": 16.317596197128296, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_146_gen_C-only.json b/results/icml_r3/X29/siso/timing/plant_146_gen_C-only.json new file mode 100644 index 0000000000000000000000000000000000000000..a4c3cb1a849caf18687e037217fed718632ee4bc --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_146_gen_C-only.json @@ -0,0 +1 @@ +{"i": 146, "method": "gen_C-only", "t_sample": 8.731089353561401, "t_score": 1.4722192287445068, "t": 10.203308582305908, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_146_hifoo2.json b/results/icml_r3/X29/siso/timing/plant_146_hifoo2.json new file mode 100644 index 0000000000000000000000000000000000000000..08cf5e3ff2d9c679f19d8e96d98b9f88669cd2cb --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_146_hifoo2.json @@ -0,0 +1 @@ +{"i": 146, "method": "hifoo2", "t": 0.10040724277496338, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_146_jopt1.json b/results/icml_r3/X29/siso/timing/plant_146_jopt1.json new file mode 100644 index 0000000000000000000000000000000000000000..cb38e6a3d3dd3f88095da7e531d9571f5291691b --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_146_jopt1.json @@ -0,0 +1 @@ +{"i": 146, "method": "jopt1", "t": 1482.8062016963959, "k": 1, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_146_jopt16.json b/results/icml_r3/X29/siso/timing/plant_146_jopt16.json new file mode 100644 index 0000000000000000000000000000000000000000..a980c31e433f0d44c4148d634c2884d1fc706574 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_146_jopt16.json @@ -0,0 +1 @@ +{"i": 146, "method": "jopt16", "t": 1712.8308458328247, "k": 16, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_146_jopt4.json b/results/icml_r3/X29/siso/timing/plant_146_jopt4.json new file mode 100644 index 0000000000000000000000000000000000000000..0d09b55fd6348a11171c0b36a3ab0fd18ebeb0a8 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_146_jopt4.json @@ -0,0 +1 @@ +{"i": 146, "method": "jopt4", "t": 1513.9111506938934, "k": 4, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_146_knn_C+phi.json b/results/icml_r3/X29/siso/timing/plant_146_knn_C+phi.json new file mode 100644 index 0000000000000000000000000000000000000000..582ce9bdaf0edc568fff78f645cdc420afad070b --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_146_knn_C+phi.json @@ -0,0 +1 @@ +{"i": 146, "method": "knn_C+phi", "t_sample": 0.0060727596282958984, "t_score": 1.1136565208435059, "t": 1.1197292804718018, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_146_knn_C-only.json b/results/icml_r3/X29/siso/timing/plant_146_knn_C-only.json new file mode 100644 index 0000000000000000000000000000000000000000..7d561ee90c1912ea8b1303bedd4cd4be95aaf2c3 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_146_knn_C-only.json @@ -0,0 +1 @@ +{"i": 146, "method": "knn_C-only", "t_sample": 2.1230621337890625, "t_score": 1.1919267177581787, "t": 3.314988851547241, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_146_twin_C+phi.json b/results/icml_r3/X29/siso/timing/plant_146_twin_C+phi.json new file mode 100644 index 0000000000000000000000000000000000000000..58e0960681f888d225d6942e52280acf910113f3 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_146_twin_C+phi.json @@ -0,0 +1 @@ +{"i": 146, "method": "twin_C+phi", "t_sample": 0.2677791118621826, "t_score": 6.375282526016235, "t": 6.643061637878418, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_146_twin_C-only.json b/results/icml_r3/X29/siso/timing/plant_146_twin_C-only.json new file mode 100644 index 0000000000000000000000000000000000000000..aa0997ad188eff730189757636e28fd36281f276 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_146_twin_C-only.json @@ -0,0 +1 @@ +{"i": 146, "method": "twin_C-only", "t_sample": 0.2297046184539795, "t_score": 1.451909065246582, "t": 1.6816136837005615, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_164_fopt1.json b/results/icml_r3/X29/siso/timing/plant_164_fopt1.json new file mode 100644 index 0000000000000000000000000000000000000000..f3c23d90f3d662a694b49e69fb4ab216d3b434bc --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_164_fopt1.json @@ -0,0 +1 @@ +{"i": 164, "method": "fopt1", "t": 1502.7948865890503, "k": 1, "load": [6.0107421875, 6.0, 5.39453125]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_164_fopt16.json b/results/icml_r3/X29/siso/timing/plant_164_fopt16.json new file mode 100644 index 0000000000000000000000000000000000000000..9f31e0be984ed0b3d332ed7b1e659b9cc7d6c3ec --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_164_fopt16.json @@ -0,0 +1 @@ +{"i": 164, "method": "fopt16", "t": 1731.49302816391, "k": 16, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_164_fopt4.json b/results/icml_r3/X29/siso/timing/plant_164_fopt4.json new file mode 100644 index 0000000000000000000000000000000000000000..d032c11352dece4d98047764235847b44c5724bb --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_164_fopt4.json @@ -0,0 +1 @@ +{"i": 164, "method": "fopt4", "t": 1540.6998355388641, "k": 4, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_164_gen_C+phi.json b/results/icml_r3/X29/siso/timing/plant_164_gen_C+phi.json new file mode 100644 index 0000000000000000000000000000000000000000..a3a008e74984abd00d70feb715a1b6036559eec6 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_164_gen_C+phi.json @@ -0,0 +1 @@ +{"i": 164, "method": "gen_C+phi", "t_sample": 8.788061618804932, "t_score": 20.431650161743164, "t": 29.219711780548096, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_164_gen_C-only.json b/results/icml_r3/X29/siso/timing/plant_164_gen_C-only.json new file mode 100644 index 0000000000000000000000000000000000000000..a6e6ce902880616c5272bd1599b757c112873830 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_164_gen_C-only.json @@ -0,0 +1 @@ +{"i": 164, "method": "gen_C-only", "t_sample": 8.618944644927979, "t_score": 8.495553255081177, "t": 17.114497900009155, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_164_hifoo2.json b/results/icml_r3/X29/siso/timing/plant_164_hifoo2.json new file mode 100644 index 0000000000000000000000000000000000000000..68674d0b7b6bcc73293566951e946c1d3f137fc0 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_164_hifoo2.json @@ -0,0 +1 @@ +{"i": 164, "method": "hifoo2", "t": 0.0606156587600708, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_164_jopt1.json b/results/icml_r3/X29/siso/timing/plant_164_jopt1.json new file mode 100644 index 0000000000000000000000000000000000000000..adc2f2cbd4138a2b7ca597df87da6038cbf9a912 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_164_jopt1.json @@ -0,0 +1 @@ +{"i": 164, "method": "jopt1", "t": 1602.0815379619598, "k": 1, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_164_jopt16.json b/results/icml_r3/X29/siso/timing/plant_164_jopt16.json new file mode 100644 index 0000000000000000000000000000000000000000..541970dae8cab47c1843250f602444483962821d --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_164_jopt16.json @@ -0,0 +1 @@ +{"i": 164, "method": "jopt16", "t": 1590.04501414299, "k": 16, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_164_jopt4.json b/results/icml_r3/X29/siso/timing/plant_164_jopt4.json new file mode 100644 index 0000000000000000000000000000000000000000..bce788df0345355e8a46453c45dc32a4d588b7b7 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_164_jopt4.json @@ -0,0 +1 @@ +{"i": 164, "method": "jopt4", "t": 1472.1422374248505, "k": 4, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_164_knn_C+phi.json b/results/icml_r3/X29/siso/timing/plant_164_knn_C+phi.json new file mode 100644 index 0000000000000000000000000000000000000000..14de2b0a70196713ea878633adf359961dc26828 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_164_knn_C+phi.json @@ -0,0 +1 @@ +{"i": 164, "method": "knn_C+phi", "t_sample": 0.005877494812011719, "t_score": 26.857537508010864, "t": 26.863415002822876, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_164_knn_C-only.json b/results/icml_r3/X29/siso/timing/plant_164_knn_C-only.json new file mode 100644 index 0000000000000000000000000000000000000000..0c4991c3a87edbf9ef1128d21dd9df733edc41ec --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_164_knn_C-only.json @@ -0,0 +1 @@ +{"i": 164, "method": "knn_C-only", "t_sample": 2.117730140686035, "t_score": 8.905799388885498, "t": 11.023529529571533, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_164_twin_C+phi.json b/results/icml_r3/X29/siso/timing/plant_164_twin_C+phi.json new file mode 100644 index 0000000000000000000000000000000000000000..75ba182c53864ca2c86f8fe7476d0768dd44bfab --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_164_twin_C+phi.json @@ -0,0 +1 @@ +{"i": 164, "method": "twin_C+phi", "t_sample": 0.26880669593811035, "t_score": 80.07140827178955, "t": 80.34021496772766, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_164_twin_C-only.json b/results/icml_r3/X29/siso/timing/plant_164_twin_C-only.json new file mode 100644 index 0000000000000000000000000000000000000000..3e9c2a124df8930c886df9058db218dc399ab9ab --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_164_twin_C-only.json @@ -0,0 +1 @@ +{"i": 164, "method": "twin_C-only", "t_sample": 0.2346341609954834, "t_score": 1.3830828666687012, "t": 1.6177170276641846, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_182_fopt1.json b/results/icml_r3/X29/siso/timing/plant_182_fopt1.json new file mode 100644 index 0000000000000000000000000000000000000000..9ab40f9ad6336cf2e164a75d8ea009bbdd32d2ff --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_182_fopt1.json @@ -0,0 +1 @@ +{"i": 182, "method": "fopt1", "t": 1583.8380510807037, "k": 1, "load": [6.0107421875, 6.0, 5.39453125]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_182_fopt16.json b/results/icml_r3/X29/siso/timing/plant_182_fopt16.json new file mode 100644 index 0000000000000000000000000000000000000000..1ab7082609d1cded9cb522eb551ae9e1c3490723 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_182_fopt16.json @@ -0,0 +1 @@ +{"i": 182, "method": "fopt16", "t": 1620.2993848323822, "k": 16, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_182_fopt4.json b/results/icml_r3/X29/siso/timing/plant_182_fopt4.json new file mode 100644 index 0000000000000000000000000000000000000000..9f239edf7f2e9657fb92cbbe6133cd9ff03caa3d --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_182_fopt4.json @@ -0,0 +1 @@ +{"i": 182, "method": "fopt4", "t": 1449.5947968959808, "k": 4, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_182_gen_C+phi.json b/results/icml_r3/X29/siso/timing/plant_182_gen_C+phi.json new file mode 100644 index 0000000000000000000000000000000000000000..d5c7ecc3b15a80862ce6d05820e670de0d5db502 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_182_gen_C+phi.json @@ -0,0 +1 @@ +{"i": 182, "method": "gen_C+phi", "t_sample": 8.621387958526611, "t_score": 26.708874702453613, "t": 35.330262660980225, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_182_gen_C-only.json b/results/icml_r3/X29/siso/timing/plant_182_gen_C-only.json new file mode 100644 index 0000000000000000000000000000000000000000..1bc39f5091d96f3f69a91321e16633b773d37f93 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_182_gen_C-only.json @@ -0,0 +1 @@ +{"i": 182, "method": "gen_C-only", "t_sample": 8.64364743232727, "t_score": 1.3990082740783691, "t": 10.04265570640564, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_182_hifoo2.json b/results/icml_r3/X29/siso/timing/plant_182_hifoo2.json new file mode 100644 index 0000000000000000000000000000000000000000..0dbc4f27122b8fb79751a4d301aaebe2baf511f5 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_182_hifoo2.json @@ -0,0 +1 @@ +{"i": 182, "method": "hifoo2", "t": 1.1704784631729126, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_182_jopt1.json b/results/icml_r3/X29/siso/timing/plant_182_jopt1.json new file mode 100644 index 0000000000000000000000000000000000000000..db4857ffdcd02c3efecf563bf60634d6df3c23ac --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_182_jopt1.json @@ -0,0 +1 @@ +{"i": 182, "method": "jopt1", "t": 1606.0049169063568, "k": 1, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_182_jopt16.json b/results/icml_r3/X29/siso/timing/plant_182_jopt16.json new file mode 100644 index 0000000000000000000000000000000000000000..b16ae16c55ffcda8205e70a02dadf83badb399d9 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_182_jopt16.json @@ -0,0 +1 @@ +{"i": 182, "method": "jopt16", "t": 1658.7392497062683, "k": 16, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_182_jopt4.json b/results/icml_r3/X29/siso/timing/plant_182_jopt4.json new file mode 100644 index 0000000000000000000000000000000000000000..c7177f0ad7acbe203deeb217cd894380c24eac6c --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_182_jopt4.json @@ -0,0 +1 @@ +{"i": 182, "method": "jopt4", "t": 1684.9185554981232, "k": 4, "load": [6.0, 6.0, 6.0]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_182_knn_C+phi.json b/results/icml_r3/X29/siso/timing/plant_182_knn_C+phi.json new file mode 100644 index 0000000000000000000000000000000000000000..063431aad27a81950c2c3159e98c7430cd6f428b --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_182_knn_C+phi.json @@ -0,0 +1 @@ +{"i": 182, "method": "knn_C+phi", "t_sample": 0.005959749221801758, "t_score": 20.444410800933838, "t": 20.45037055015564, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_182_knn_C-only.json b/results/icml_r3/X29/siso/timing/plant_182_knn_C-only.json new file mode 100644 index 0000000000000000000000000000000000000000..739725b736a0d6b0f025aabd89af51fec2c90781 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_182_knn_C-only.json @@ -0,0 +1 @@ +{"i": 182, "method": "knn_C-only", "t_sample": 2.1006224155426025, "t_score": 26.686119079589844, "t": 28.786741495132446, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_182_twin_C+phi.json b/results/icml_r3/X29/siso/timing/plant_182_twin_C+phi.json new file mode 100644 index 0000000000000000000000000000000000000000..63392c26e14d50f83b050f72308ddd0c5cc5b312 --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_182_twin_C+phi.json @@ -0,0 +1 @@ +{"i": 182, "method": "twin_C+phi", "t_sample": 0.228928804397583, "t_score": 7.3397204875946045, "t": 7.5686492919921875, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing/plant_182_twin_C-only.json b/results/icml_r3/X29/siso/timing/plant_182_twin_C-only.json new file mode 100644 index 0000000000000000000000000000000000000000..ed180cab4b9d02304d658b455f69e5b67211fefd --- /dev/null +++ b/results/icml_r3/X29/siso/timing/plant_182_twin_C-only.json @@ -0,0 +1 @@ +{"i": 182, "method": "twin_C-only", "t_sample": 0.2045440673828125, "t_score": 26.408141136169434, "t": 26.612685203552246, "load": [1.01220703125, 2.14892578125, 4.05224609375]} \ No newline at end of file diff --git a/results/icml_r3/X29/siso/timing_batched.json b/results/icml_r3/X29/siso/timing_batched.json new file mode 100644 index 0000000000000000000000000000000000000000..3f3d86c93bd9d0a2480ad74b488dcf1ffd97652e --- /dev/null +++ b/results/icml_r3/X29/siso/timing_batched.json @@ -0,0 +1,10 @@ +{ + "device": "cuda", + "plants": 199, + "gen_C-only": 0.019175630118978684, + "twin_C-only": 0.003021505010786967, + "gen_C+phi": 0.019221443626748855, + "twin_C+phi": 0.0028715972325310635, + "knn_C-only": 0.012745159954281908, + "knn_C+phi": 0.005089527398497615 +} \ No newline at end of file