DiffusionControl / results /timing /timing_vs_classical_tables.md
matCercola18's picture
Add files using upload-large-folder tool
282f14b verified
|
Raw History Blame Contribute Delete
8.98 kB

SISO (batch = 60)

method b1 CPU-1t b1 CPU-8t b1 GPU batch CPU-1t batch CPU-8t batch GPU cov/cert med regret %
diffusion DDPM500 K=1 3.37e+03 (3.56e+03) 2.7e+03 (2.98e+03) 635 (648) 341 (348) 82.6 (83.4) 11 (11) 0.672 +773.3
diffusion DDPM500 K=8 9.44e+03 (9.95e+03) 2.06e+03 (2.35e+03) 565 (574) 1.71e+03 (1.73e+03) 536 (571) 22.7 (22.8) 0.794 +23.7
diffusion DDIM20 K=1 243 (255) 220 (234) 132 (158) 16.1 (16.2) 6.27 (7.18) 3 (3.02) 0.644 +559.4
diffusion DDIM20 K=8 500 (505) 202 (222) 141 (148) 78.9 (78.9) 19 (20.6) 8.26 (8.29) 0.800 +5.7
diffusion DDIM5 K=1 142 (145) 144 (157) 121 (124) 5.94 (5.98) 3.95 (4.82) 2.82 (2.85) 0.694 +482.0
diffusion DDIM5 K=8 215 (218) 145 (164) 126 (128) 25.2 (25.7) 10.4 (12) 7.75 (7.78) 0.817 -0.5
retrieval K=1 (distinct plants) 109 (112) 116 (130) n/a 2.71 (2.73) 3.2 (4.09) n/a 0.517 +72.7
retrieval K=8 (distinct plants) 122 (123) 125 (144) n/a 7.8 (7.83) 7.67 (9.35) n/a 0.767 +4.3
per-plant Adam oracle 2.83e+04 (2.92e+04) 2.19e+04 (2.21e+04) n/a 584 (585) 507 (514) n/a 1.000 +0.0
Hurwitz eigenvalue linear gain (stabilize_repair_fast) 0.301 (0.85) 0.329 (1.34) n/a n/a n/a n/a n/a n/a
static-gain LQ design F=1 + eigenvalue cert 2.35 (3.04) 2.64 (3.94) n/a 2.35 (3.8) 2.41 (4.75) n/a 0.883 +1274.6

MIMO (batch = 120)

method b1 CPU-1t b1 CPU-8t b1 GPU batch CPU-1t batch CPU-8t batch GPU cov/cert med regret %
diffusion DDPM500 K=1 1.68e+03 (5.3e+03) 1.46e+03 (4.77e+03) 651 (4.35e+03) 584 (662) 522 (599) 484 (562) 0.953 +10.7
diffusion DDPM500 K=8 3.72e+03 (6.94e+03) 1.9e+03 (5.45e+03) 1.62e+03 (5.21e+03) 1.21e+03 (1.3e+03) 632 (710) 501 (579) 0.994 +2.5
diffusion DDIM20 K=1 268 (3.98e+03) 235 (3.79e+03) 225 (3.93e+03) 485 (563) 495 (573) 481 (559) 0.953 +9.9
diffusion DDIM20 K=8 1.25e+03 (4.96e+03) 1.09e+03 (4.63e+03) 1.17e+03 (4.88e+03) 522 (600) 512 (590) 494 (572) 0.992 +3.3
diffusion DDIM5 K=1 223 (3.93e+03) 197 (3.75e+03) 211 (3.92e+03) 482 (560) 494 (572) 481 (559) 0.958 +10.0
diffusion DDIM5 K=8 1.18e+03 (4.89e+03) 1.06e+03 (4.61e+03) 1.16e+03 (4.87e+03) 501 (579) 508 (586) 493 (571) 0.992 +4.3
retrieval K=1 206 (3.91e+03) 184 (3.74e+03) n/a 481 (559) 494 (572) n/a 0.860 +13.7
retrieval K=8 1.16e+03 (4.86e+03) 1.05e+03 (4.6e+03) n/a 494 (572) 507 (585) n/a 0.990 +2.6
per-plant Adam oracle 1.1e+05 (1.29e+05) 8.82e+04 (1.73e+05) 2.55e+05 (2.68e+05) 1.15e+03 (1.15e+03) 1.13e+03 (1.17e+03) 2.58e+03 (2.67e+03) 1.000 +0.0
circle-criterion LMI bisection + linear gain 66.2 (3.76e+03) 72.3 (3.82e+03) n/a 479 (557) 492 (570) n/a 1.000 +13.9

PEND (batch = 40)

method b1 CPU-1t b1 CPU-8t b1 GPU batch CPU-1t batch CPU-8t batch GPU cov/cert med regret %
diffusion DDPM500 K=1 442 (628) 460 (481) 430 (443) 61 (71.8) 41.8 (58.4) 16 (27.2) 0.992 +1.5
diffusion DDPM500 K=8 1.1e+03 (1.56e+03) 687 (1.34e+03) 410 (851) 355 (390) 164 (214) 65.6 (102) 1.000 +1.1
diffusion DDIM20 K=1 60.3 (62.7) 93.8 (101) 61.4 (69.3) 8.54 (19.5) 16.8 (33.5) 7 (17.9) 1.000 +1.5
diffusion DDIM20 K=8 118 (558) 159 (831) 99 (539) 67.8 (104) 73.8 (113) 56.6 (92.5) 1.000 +1.1
diffusion DDIM5 K=1 48.8 (50.6) 82.2 (91.4) 49.1 (50.9) 7.09 (18) 16 (32.8) 6.69 (17.6) 0.975 +1.5
diffusion DDIM5 K=8 93 (533) 144 (815) 88.3 (529) 59.1 (95) 71.2 (110) 56.3 (92.2) 1.000 +1.0
retrieval K=1 44.7 (46.6) 78.2 (85.8) n/a 6.62 (17.6) 15.8 (32.6) n/a 1.000 +1.8
retrieval K=8 84.6 (525) 139 (810) n/a 56.3 (92.2) 70.5 (109) n/a 1.000 +0.4
per-plant Adam oracle 1.66e+04 (1.71e+04) 1.47e+04 (1.5e+04) n/a n/a n/a n/a 1.000 +0.0
LQR (Riccati, linearisation) + Lyapunov cert 0.302 (0.334) 0.316 (0.37) n/a 0.304 (0.314) 0.315 (0.439) n/a 1.000 -1.1

Generation only (no verification), ms per plant, median (p99)

family sampler K b1 CPU-1t b1 CPU-8t b1 GPU batch CPU-1t batch CPU-8t batch GPU
siso DDPM500 1 3.26e+03 (3.45e+03) 2.58e+03 (2.86e+03) 526 (539) 339 (350) 79.4 (79.6) 8.35 (8.41)
siso DDPM500 8 9.31e+03 (9.83e+03) 1.93e+03 (2.23e+03) 443 (451) 1.7e+03 (1.72e+03) 528 (564) 15.2 (15.3)
siso DDIM20 1 134 (146) 104 (109) 22.8 (48.5) 13.5 (13.6) 3.15 (3.29) 0.366 (0.464)
siso DDIM20 8 379 (384) 77.4 (83.5) 19.5 (25.3) 71.3 (71.4) 11.5 (11.5) 0.684 (0.686)
siso DDIM5 1 33 (34.3) 27.6 (30.4) 12.7 (13.7) 3.31 (3.37) 0.827 (0.84) 0.116 (0.198)
siso DDIM5 8 94.3 (96.3) 21.2 (22.1) 5.2 (5.49) 18.2 (18.3) 2.88 (2.94) 0.178 (0.181)
mimo DDPM500 1 1.45e+03 (1.57e+03) 1.28e+03 (1.31e+03) 442 (462) 103 (104) 27.6 (27.7) 3.37 (3.4)
mimo DDPM500 8 2.49e+03 (2.64e+03) 850 (856) 367 (759) 712 (725) 125 (125) 7.34 (7.6)
mimo DDIM20 1 62.1 (63.8) 51.7 (54.5) 18.9 (26.2) 4.02 (4.16) 1.11 (1.12) 0.145 (0.147)
mimo DDIM20 8 97.7 (104) 34.3 (35) 15.3 (21.9) 29.4 (29.7) 5.07 (5.72) 0.265 (0.268)
mimo DDIM5 1 17.5 (18.3) 13.2 (14.2) 4.94 (6.44) 1.05 (1.08) 0.279 (0.285) 0.0383 (0.0395)
mimo DDIM5 8 26.2 (26.5) 9.02 (9.62) 4.08 (5.95) 7.29 (7.44) 1.25 (1.29) 0.0685 (0.0692)
pend DDPM500 1 398 (510) 381 (403) 385 (397) 54.4 (54.5) 25.9 (26.2) 9.47 (10)
pend DDPM500 8 1.01e+03 (1.04e+03) 529 (773) 326 (343) 293 (299) 85.6 (110) 9.26 (9.76)
pend DDIM20 1 15.6 (16.7) 15.4 (19.9) 16.7 (21.9) 1.98 (2.03) 1.03 (1.14) 0.413 (0.426)
pend DDIM20 8 33 (35) 21 (26.4) 14.4 (19.1) 11.7 (11.8) 3.42 (3.54) 0.408 (0.539)
pend DDIM5 1 4.19 (5.01) 4.1 (5.87) 4.42 (4.89) 0.508 (0.525) 0.261 (0.264) 0.109 (0.115)
pend DDIM5 8 8.57 (9.48) 5.48 (6.5) 3.87 (5.34) 2.92 (2.94) 0.857 (0.93) 0.109 (0.114)
furuta DDPM500 1 483 (496) 389 (407) 395 (404) 48 (48.1) 22.4 (22.5) 6.3 (6.41)
furuta DDPM500 8 826 (991) 518 (528) 335 (407) 287 (290) 78.9 (130) 6.3 (6.36)
furuta DDPM500 16 1.05e+03 (1.09e+03) 675 (681) n/a 550 (564) 132 (132) n/a
furuta DDIM20 1 23.7 (25.1) 15.8 (16.5) 17.2 (18.2) 1.92 (1.95) 0.896 (0.952) 0.274 (0.282)
furuta DDIM20 8 41.8 (43.4) 20.9 (21.2) 14.5 (15.3) 11.7 (11.8) 3.1 (3.11) 0.321 (0.324)
furuta DDIM20 16 53.6 (55.5) 27.5 (28.1) n/a 23.4 (23.6) 5.14 (5.16) n/a
furuta DDIM5 1 5.54 (6.42) 4.21 (4.88) 4.57 (4.86) 0.485 (0.491) 0.227 (0.229) 0.0746 (0.0762)
furuta DDIM5 8 10.8 (11.9) 5.56 (6) 3.97 (4.17) 2.94 (2.98) 0.782 (0.787) 0.0853 (0.0865)
furuta DDIM5 16 13.7 (14.7) 7.15 (7.31) n/a 5.85 (5.91) 1.28 (1.29) n/a

FURUTA synthesis (offline, per plant, ms)

method median p99 max n success % median J
collocation + TVLQR (per plant) 1.126e+04 5.769e+04 5.805e+04 60 75.0 4.25
NMPC trajectory solve (per plant, offline) 32.99 85.59 96.96 60 95.0 4.1
NMPC + certificate SDP (per plant) 9112 2.465e+04 2.831e+04 60 95.0 4.1
retrieval + P re-solve (K=4) 557.8 3817 5098 120 82.5 4.109
retrieval + P re-solve (K=8) 557.8 7375 7503 120 90.0 4.121
retrieval + P re-solve (K=16) 557.8 1.15e+04 1.502e+04 120 93.3 4.157
diffusion generated + P (DDPM500, K=8) [cpu1] 1893 8356 1.203e+04 120 65.3 None
diffusion generated + P (DDIM20, K=8) [cpu1] 1008 7409 1.124e+04 120 65.3 None
diffusion generated + P (DDIM5, K=8) [cpu1] 977.1 7379 1.121e+04 120 65.3 None
diffusion generated + P (DDPM500, K=8) [cpu8] 1484 7885 1.172e+04 120 65.3 None
diffusion generated + P (DDIM20, K=8) [cpu8] 987.1 7389 1.122e+04 120 65.3 None
diffusion generated + P (DDIM5, K=8) [cpu8] 971.8 7374 1.12e+04 120 65.3 None
diffusion generated + P (DDPM500, K=8) [gpu] 1301 7705 1.153e+04 120 65.3 None
diffusion generated + P (DDIM20, K=8) [gpu] 980.8 7383 1.121e+04 120 65.3 None
diffusion generated + P (DDIM5, K=8) [gpu] 970.2 7372 1.12e+04 120 65.3 None