Download log_refill_before.txt from Asilarkness/tinystories-diff-ar: direct link, hf CLI and curl.
- Browser
- Download file 4.85 kB
-
https://huggingface.co/Asilarkness/tinystories-diff-ar/resolve/main/log_refill_before.txt
- Command line
-
hf download hf://Asilarkness/tinystories-diff-ar/log_refill_before.txt
-
curl -L -o log_refill_before.txt https://huggingface.co/Asilarkness/tinystories-diff-ar/resolve/main/log_refill_before.txt
4.85 kB
| bench d1 | |
| 10:22:04 loaded d1 step=78000 seen=1278.0M | |
| 10:22:07 loaded ar step=65000 seen=1065.0M | |
| 10:22:13 === baselines === | |
| 10:22:15 AR (ceiling) calls=128 0.3348s 24466 tok/s nll=2.8986 dup=0.0201 d2=0.5169 | |
| 10:22:15 DIFF K=2 calls=2 0.0157s 523289 tok/s nll=8.1330 dup=0.0506 d2=0.5904 | |
| 10:22:16 DIFF K=4 calls=4 0.0311s 263707 tok/s nll=5.7442 dup=0.0561 d2=0.4779 | |
| 10:22:16 DIFF K=6 calls=6 0.0464s 176517 tok/s nll=4.9298 dup=0.0563 d2=0.4450 | |
| 10:22:16 DIFF K=8 calls=8 0.0620s 132049 tok/s nll=4.4687 dup=0.0560 d2=0.4438 | |
| 10:22:17 DIFF K=10 calls=10 0.0773s 105944 tok/s nll=4.1071 dup=0.0465 d2=0.4221 | |
| 10:22:17 DIFF K=12 calls=12 0.0931s 88001 tok/s nll=3.9702 dup=0.0471 d2=0.4243 | |
| 10:22:18 DIFF K=16 calls=16 0.1235s 66347 tok/s nll=3.4351 dup=0.0429 d2=0.4074 | |
| 10:22:18 DIFF K=20 calls=20 0.1546s 52982 tok/s nll=3.2630 dup=0.0395 d2=0.4133 | |
| 10:22:19 DIFF K=24 calls=24 0.1852s 44228 tok/s nll=3.1630 dup=0.0380 d2=0.4054 | |
| 10:22:19 === diffusion + refill, matched call budgets === | |
| 10:22:19 K=4 p=0.10 R=1 calls=5 0.0362s 226225 tok/s nll=4.9697 dup=0.0550 d2=0.4266 | |
| 10:22:20 K=4 p=0.10 R=2 calls=6 0.0416s 196999 tok/s nll=4.7276 dup=0.0528 d2=0.4206 | |
| 10:22:20 K=4 p=0.10 R=4 calls=8 0.0536s 152814 tok/s nll=4.4119 dup=0.0523 d2=0.4216 | |
| 10:22:20 K=4 p=0.20 R=1 calls=5 0.0369s 222019 tok/s nll=4.7627 dup=0.0517 d2=0.4381 | |
| 10:22:21 K=4 p=0.20 R=2 calls=6 0.0422s 193955 tok/s nll=4.3189 dup=0.0527 d2=0.4269 | |
| 10:22:21 K=4 p=0.20 R=4 calls=8 0.0536s 152843 tok/s nll=3.8024 dup=0.0434 d2=0.4211 | |
| 10:22:21 K=4 p=0.30 R=1 calls=5 0.0370s 221551 tok/s nll=4.9045 dup=0.0538 d2=0.4430 | |
| 10:22:22 K=4 p=0.30 R=2 calls=6 0.0428s 191389 tok/s nll=4.3630 dup=0.0444 d2=0.4392 | |
| 10:22:22 K=4 p=0.30 R=4 calls=8 0.0547s 149880 tok/s nll=3.6176 dup=0.0394 d2=0.4323 | |
| 10:22:22 K=4 p=0.50 R=1 calls=5 0.0378s 216889 tok/s nll=4.8723 dup=0.0485 d2=0.4713 | |
| 10:22:23 K=4 p=0.50 R=2 calls=6 0.0438s 187073 tok/s nll=4.5311 dup=0.0437 d2=0.4734 | |
| 10:22:23 K=4 p=0.50 R=4 calls=8 0.0562s 145658 tok/s nll=4.8553 dup=0.0418 d2=0.4957 | |
| 10:22:24 K=8 p=0.10 R=1 calls=9 0.0673s 121746 tok/s nll=3.8610 dup=0.0493 d2=0.4026 | |
| 10:22:24 K=8 p=0.10 R=2 calls=10 0.0728s 112487 tok/s nll=3.7104 dup=0.0493 d2=0.3990 | |
| 10:22:24 K=8 p=0.10 R=4 calls=12 0.0849s 96435 tok/s nll=3.4375 dup=0.0404 d2=0.4183 | |
| 10:22:25 K=8 p=0.20 R=1 calls=9 0.0675s 121308 tok/s nll=3.9440 dup=0.0463 d2=0.4186 | |
| 10:22:25 K=8 p=0.20 R=2 calls=10 0.0730s 112265 tok/s nll=3.5781 dup=0.0389 d2=0.4203 | |
| 10:22:26 K=8 p=0.20 R=4 calls=12 0.0858s 95522 tok/s nll=3.0231 dup=0.0358 d2=0.4088 | |
| 10:22:26 K=8 p=0.30 R=1 calls=9 0.0671s 122176 tok/s nll=3.9184 dup=0.0437 d2=0.4215 | |
| 10:22:27 K=8 p=0.30 R=2 calls=10 0.0734s 111555 tok/s nll=3.5091 dup=0.0420 d2=0.4306 | |
| 10:22:27 K=8 p=0.30 R=4 calls=12 0.0853s 96012 tok/s nll=3.1743 dup=0.0348 d2=0.4213 | |
| 10:22:27 K=8 p=0.50 R=1 calls=9 0.0675s 121402 tok/s nll=4.1907 dup=0.0396 d2=0.4600 | |
| 10:22:28 K=8 p=0.50 R=2 calls=10 0.0738s 110947 tok/s nll=4.1945 dup=0.0322 d2=0.4787 | |
| 10:22:28 K=8 p=0.50 R=4 calls=12 0.0874s 93724 tok/s nll=4.6549 dup=0.0386 d2=0.4943 | |
| 10:22:29 K=12 p=0.10 R=1 calls=13 0.0968s 84625 tok/s nll=3.6755 dup=0.0455 d2=0.4082 | |
| 10:22:29 K=12 p=0.10 R=2 calls=14 0.1025s 79925 tok/s nll=3.3101 dup=0.0402 d2=0.4221 | |
| 10:22:30 K=12 p=0.10 R=4 calls=16 0.1138s 71993 tok/s nll=3.1429 dup=0.0397 d2=0.4126 | |
| 10:22:30 K=12 p=0.20 R=1 calls=13 0.0978s 83796 tok/s nll=3.5620 dup=0.0429 d2=0.4163 | |
| 10:22:31 K=12 p=0.20 R=2 calls=14 0.1052s 77834 tok/s nll=3.1824 dup=0.0356 d2=0.4220 | |
| 10:22:31 K=12 p=0.20 R=4 calls=16 0.1139s 71914 tok/s nll=2.8586 dup=0.0288 d2=0.4162 | |
| 10:22:32 K=12 p=0.30 R=1 calls=13 0.0972s 84300 tok/s nll=3.5599 dup=0.0378 d2=0.4332 | |
| 10:22:32 K=12 p=0.30 R=2 calls=14 0.1041s 78684 tok/s nll=3.2104 dup=0.0338 d2=0.4418 | |
| 10:22:33 K=12 p=0.30 R=4 calls=16 0.1148s 71389 tok/s nll=3.1720 dup=0.0325 d2=0.4182 | |
| 10:22:33 K=12 p=0.50 R=1 calls=13 0.0980s 83601 tok/s nll=4.0057 dup=0.0375 d2=0.4654 | |
| 10:22:34 K=12 p=0.50 R=2 calls=14 0.1043s 78556 tok/s nll=4.1454 dup=0.0320 d2=0.4737 | |
| 10:22:35 K=12 p=0.50 R=4 calls=16 0.1171s 69979 tok/s nll=4.5204 dup=0.0357 d2=0.4918 | |
| 10:22:35 REAL TEXT nll=0.9623 dup=0.0156 d2=0.5253 | |