File size: 4,846 Bytes
b4479e0 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 | bench d1 10:22:04 loaded d1 step=78000 seen=1278.0M 10:22:07 loaded ar step=65000 seen=1065.0M 10:22:13 === baselines === 10:22:15 AR (ceiling) calls=128 0.3348s 24466 tok/s nll=2.8986 dup=0.0201 d2=0.5169 10:22:15 DIFF K=2 calls=2 0.0157s 523289 tok/s nll=8.1330 dup=0.0506 d2=0.5904 10:22:16 DIFF K=4 calls=4 0.0311s 263707 tok/s nll=5.7442 dup=0.0561 d2=0.4779 10:22:16 DIFF K=6 calls=6 0.0464s 176517 tok/s nll=4.9298 dup=0.0563 d2=0.4450 10:22:16 DIFF K=8 calls=8 0.0620s 132049 tok/s nll=4.4687 dup=0.0560 d2=0.4438 10:22:17 DIFF K=10 calls=10 0.0773s 105944 tok/s nll=4.1071 dup=0.0465 d2=0.4221 10:22:17 DIFF K=12 calls=12 0.0931s 88001 tok/s nll=3.9702 dup=0.0471 d2=0.4243 10:22:18 DIFF K=16 calls=16 0.1235s 66347 tok/s nll=3.4351 dup=0.0429 d2=0.4074 10:22:18 DIFF K=20 calls=20 0.1546s 52982 tok/s nll=3.2630 dup=0.0395 d2=0.4133 10:22:19 DIFF K=24 calls=24 0.1852s 44228 tok/s nll=3.1630 dup=0.0380 d2=0.4054 10:22:19 === diffusion + refill, matched call budgets === 10:22:19 K=4 p=0.10 R=1 calls=5 0.0362s 226225 tok/s nll=4.9697 dup=0.0550 d2=0.4266 10:22:20 K=4 p=0.10 R=2 calls=6 0.0416s 196999 tok/s nll=4.7276 dup=0.0528 d2=0.4206 10:22:20 K=4 p=0.10 R=4 calls=8 0.0536s 152814 tok/s nll=4.4119 dup=0.0523 d2=0.4216 10:22:20 K=4 p=0.20 R=1 calls=5 0.0369s 222019 tok/s nll=4.7627 dup=0.0517 d2=0.4381 10:22:21 K=4 p=0.20 R=2 calls=6 0.0422s 193955 tok/s nll=4.3189 dup=0.0527 d2=0.4269 10:22:21 K=4 p=0.20 R=4 calls=8 0.0536s 152843 tok/s nll=3.8024 dup=0.0434 d2=0.4211 10:22:21 K=4 p=0.30 R=1 calls=5 0.0370s 221551 tok/s nll=4.9045 dup=0.0538 d2=0.4430 10:22:22 K=4 p=0.30 R=2 calls=6 0.0428s 191389 tok/s nll=4.3630 dup=0.0444 d2=0.4392 10:22:22 K=4 p=0.30 R=4 calls=8 0.0547s 149880 tok/s nll=3.6176 dup=0.0394 d2=0.4323 10:22:22 K=4 p=0.50 R=1 calls=5 0.0378s 216889 tok/s nll=4.8723 dup=0.0485 d2=0.4713 10:22:23 K=4 p=0.50 R=2 calls=6 0.0438s 187073 tok/s nll=4.5311 dup=0.0437 d2=0.4734 10:22:23 K=4 p=0.50 R=4 calls=8 0.0562s 145658 tok/s nll=4.8553 dup=0.0418 d2=0.4957 10:22:24 K=8 p=0.10 R=1 calls=9 0.0673s 121746 tok/s nll=3.8610 dup=0.0493 d2=0.4026 10:22:24 K=8 p=0.10 R=2 calls=10 0.0728s 112487 tok/s nll=3.7104 dup=0.0493 d2=0.3990 10:22:24 K=8 p=0.10 R=4 calls=12 0.0849s 96435 tok/s nll=3.4375 dup=0.0404 d2=0.4183 10:22:25 K=8 p=0.20 R=1 calls=9 0.0675s 121308 tok/s nll=3.9440 dup=0.0463 d2=0.4186 10:22:25 K=8 p=0.20 R=2 calls=10 0.0730s 112265 tok/s nll=3.5781 dup=0.0389 d2=0.4203 10:22:26 K=8 p=0.20 R=4 calls=12 0.0858s 95522 tok/s nll=3.0231 dup=0.0358 d2=0.4088 10:22:26 K=8 p=0.30 R=1 calls=9 0.0671s 122176 tok/s nll=3.9184 dup=0.0437 d2=0.4215 10:22:27 K=8 p=0.30 R=2 calls=10 0.0734s 111555 tok/s nll=3.5091 dup=0.0420 d2=0.4306 10:22:27 K=8 p=0.30 R=4 calls=12 0.0853s 96012 tok/s nll=3.1743 dup=0.0348 d2=0.4213 10:22:27 K=8 p=0.50 R=1 calls=9 0.0675s 121402 tok/s nll=4.1907 dup=0.0396 d2=0.4600 10:22:28 K=8 p=0.50 R=2 calls=10 0.0738s 110947 tok/s nll=4.1945 dup=0.0322 d2=0.4787 10:22:28 K=8 p=0.50 R=4 calls=12 0.0874s 93724 tok/s nll=4.6549 dup=0.0386 d2=0.4943 10:22:29 K=12 p=0.10 R=1 calls=13 0.0968s 84625 tok/s nll=3.6755 dup=0.0455 d2=0.4082 10:22:29 K=12 p=0.10 R=2 calls=14 0.1025s 79925 tok/s nll=3.3101 dup=0.0402 d2=0.4221 10:22:30 K=12 p=0.10 R=4 calls=16 0.1138s 71993 tok/s nll=3.1429 dup=0.0397 d2=0.4126 10:22:30 K=12 p=0.20 R=1 calls=13 0.0978s 83796 tok/s nll=3.5620 dup=0.0429 d2=0.4163 10:22:31 K=12 p=0.20 R=2 calls=14 0.1052s 77834 tok/s nll=3.1824 dup=0.0356 d2=0.4220 10:22:31 K=12 p=0.20 R=4 calls=16 0.1139s 71914 tok/s nll=2.8586 dup=0.0288 d2=0.4162 10:22:32 K=12 p=0.30 R=1 calls=13 0.0972s 84300 tok/s nll=3.5599 dup=0.0378 d2=0.4332 10:22:32 K=12 p=0.30 R=2 calls=14 0.1041s 78684 tok/s nll=3.2104 dup=0.0338 d2=0.4418 10:22:33 K=12 p=0.30 R=4 calls=16 0.1148s 71389 tok/s nll=3.1720 dup=0.0325 d2=0.4182 10:22:33 K=12 p=0.50 R=1 calls=13 0.0980s 83601 tok/s nll=4.0057 dup=0.0375 d2=0.4654 10:22:34 K=12 p=0.50 R=2 calls=14 0.1043s 78556 tok/s nll=4.1454 dup=0.0320 d2=0.4737 10:22:35 K=12 p=0.50 R=4 calls=16 0.1171s 69979 tok/s nll=4.5204 dup=0.0357 d2=0.4918 10:22:35 REAL TEXT nll=0.9623 dup=0.0156 d2=0.5253 |