File size: 1,774 Bytes
68a167f
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
  verified ddim5
  verified ddim20
  verified ddim100
  verified ddim500
  verified ddpm500
/home/cercola/matte_server/DiffusionControl/nonlinear/experiments/bank_density_siso_mimo.py:205: RuntimeWarning: invalid value encountered in subtract
  return np.where(np.isfinite(bestJ), (bestJ - oracle) / np.clip(oracle, 1e-9, None) * 100.0, np.nan)
/home/cercola/matte_server/DiffusionControl/nonlinear/experiments/bank_density_siso_mimo.py:205: RuntimeWarning: invalid value encountered in divide
  return np.where(np.isfinite(bestJ), (bestJ - oracle) / np.clip(oracle, 1e-9, None) * 100.0, np.nan)
=== SISO DDIM steps sweep (plants seed 0, N=60, K=8, sampler seeds (0, 1, 2), eta=0, device=cuda) ===
model fixed (full-data SISO); verifier/x0 = retrieval_baselines.py siso (x0 seed 777); oracle = 60-step Adam refinement of the DDPM@500 seed-0 K=8 winner (as bank_density; negative regret possible).
regret 'common' = median over plants covered by EVERY arm's seed-0 draw (n=46); 'own' = over each draw's own covered plants. ms/ctrl = wall time per sampled controller, batch 480.
arm                 cov      per-samp   reg common%      reg own%          ms/ctrl   McNemar vs ddpm500 (n10,n01,p)
ddim5      0.817+-0.017  0.682+-0.009    1.25+-9.75   -0.46+-5.83     0.039+-0.029                    (3, 0) p=0.25
ddim20     0.800+-0.017  0.658+-0.006   5.76+-13.42   5.71+-13.39     0.086+-0.000                       (2, 1) p=1
ddim100    0.794+-0.025  0.634+-0.014   14.75+-9.27   13.04+-7.10     0.461+-0.005                       (0, 1) p=1
ddim500    0.789+-0.010  0.622+-0.019  19.11+-10.09   16.61+-7.12     2.292+-0.010                       (1, 1) p=1
ddpm500    0.794+-0.010  0.632+-0.013  25.27+-11.55  23.72+-10.49     1.997+-0.005                       (0, 0) p=1