Buckets:
| [2026-10-08T13:51:36Z step 1830001] loss=1.0550 lr=7.19012e-05 lr_phase=decay grad_norm=1.304 tokens/s=12.03M mfu=35.1% moe_balance_loss=0.0217 expert_gini=0.0231 | |
| [2026-10-08T13:51:43Z step 1830002] loss=1.0560 lr=7.19005e-05 lr_phase=decay grad_norm=1.341 tokens/s=11.76M mfu=34.3% moe_balance_loss=0.0213 expert_gini=0.0228 | |
| [2026-10-08T13:51:50Z step 1830003] loss=1.0497 lr=7.18999e-05 lr_phase=decay grad_norm=1.333 tokens/s=11.52M mfu=33.6% moe_balance_loss=0.0213 expert_gini=0.0223 | |
| [2026-10-08T13:51:57Z step 1830004] loss=1.0518 lr=7.18992e-05 lr_phase=decay grad_norm=1.294 tokens/s=12.11M mfu=35.3% moe_balance_loss=0.0213 expert_gini=0.0227 | |
| [2026-10-08T13:52:04Z step 1830005] loss=1.0473 lr=7.18985e-05 lr_phase=decay grad_norm=1.225 tokens/s=12.55M mfu=36.6% moe_balance_loss=0.0217 expert_gini=0.0233 | |
| [2026-10-08T13:52:10Z step 1830006] loss=1.0511 lr=7.18979e-05 lr_phase=decay grad_norm=1.308 tokens/s=13.18M mfu=38.5% moe_balance_loss=0.0217 expert_gini=0.0236 | |
| [2026-10-08T13:52:17Z step 1830007] loss=1.0453 lr=7.18972e-05 lr_phase=decay grad_norm=1.200 tokens/s=12.49M mfu=36.5% moe_balance_loss=0.0216 expert_gini=0.0234 | |
| [2026-10-08T13:52:24Z step 1830008] loss=1.0447 lr=7.18965e-05 lr_phase=decay grad_norm=1.532 tokens/s=12.95M mfu=37.8% moe_balance_loss=0.0218 expert_gini=0.0236 | |
| [2026-10-08T13:52:30Z step 1830009] loss=1.0521 lr=7.18959e-05 lr_phase=decay grad_norm=1.242 tokens/s=13.15M mfu=38.4% moe_balance_loss=0.0217 expert_gini=0.0238 | |
| [2026-10-08T13:52:37Z step 1830010] loss=1.0495 lr=7.18952e-05 lr_phase=decay grad_norm=1.121 tokens/s=12.84M mfu=37.5% moe_balance_loss=0.0215 expert_gini=0.0232 | |
| [2026-10-08T13:52:43Z step 1830011] loss=1.0486 lr=7.18946e-05 lr_phase=decay grad_norm=1.300 tokens/s=13.03M mfu=38.0% moe_balance_loss=0.0216 expert_gini=0.0234 | |
| [2026-10-08T13:52:50Z step 1830012] loss=1.0441 lr=7.18939e-05 lr_phase=decay grad_norm=1.468 tokens/s=12.89M mfu=37.6% moe_balance_loss=0.0214 expert_gini=0.0230 | |
| [2026-10-08T13:52:57Z step 1830013] loss=1.0424 lr=7.18932e-05 lr_phase=decay grad_norm=1.234 tokens/s=12.29M mfu=35.9% moe_balance_loss=0.0214 expert_gini=0.0230 | |
| [2026-10-08T13:53:04Z step 1830014] loss=1.0472 lr=7.18926e-05 lr_phase=decay grad_norm=1.217 tokens/s=11.56M mfu=33.7% moe_balance_loss=0.0213 expert_gini=0.0229 | |
| [2026-10-08T13:53:11Z step 1830015] loss=1.0534 lr=7.18919e-05 lr_phase=decay grad_norm=1.382 tokens/s=12.31M mfu=35.9% moe_balance_loss=0.0216 expert_gini=0.0234 | |
| [2026-10-08T13:53:18Z step 1830016] loss=1.0586 lr=7.18912e-05 lr_phase=decay grad_norm=1.309 tokens/s=12.81M mfu=37.4% moe_balance_loss=0.0215 expert_gini=0.0236 | |
| [2026-10-08T13:53:25Z step 1830017] loss=1.0548 lr=7.18906e-05 lr_phase=decay grad_norm=1.310 tokens/s=12.61M mfu=36.8% moe_balance_loss=0.0217 expert_gini=0.0236 | |
| [2026-10-08T13:53:31Z step 1830018] loss=1.0564 lr=7.18899e-05 lr_phase=decay grad_norm=1.309 tokens/s=12.66M mfu=37.0% moe_balance_loss=0.0216 expert_gini=0.0233 | |
| [2026-10-08T13:53:38Z step 1830019] loss=1.0575 lr=7.18892e-05 lr_phase=decay grad_norm=1.625 tokens/s=12.49M mfu=36.5% moe_balance_loss=0.0217 expert_gini=0.0233 | |
| [2026-10-08T13:53:45Z step 1830020] loss=1.0433 lr=7.18886e-05 lr_phase=decay grad_norm=1.190 tokens/s=12.11M mfu=35.3% moe_balance_loss=0.0216 expert_gini=0.0227 | |
| [2026-10-08T13:53:52Z step 1830021] loss=1.0457 lr=7.18879e-05 lr_phase=decay grad_norm=1.237 tokens/s=11.56M mfu=33.7% moe_balance_loss=0.0217 expert_gini=0.0229 | |
| [2026-10-08T13:54:00Z step 1830022] loss=1.0511 lr=7.18873e-05 lr_phase=decay grad_norm=1.256 tokens/s=12.15M mfu=35.5% moe_balance_loss=0.0219 expert_gini=0.0237 | |
| [2026-10-08T13:54:07Z step 1830023] loss=1.0450 lr=7.18866e-05 lr_phase=decay grad_norm=1.329 tokens/s=12.39M mfu=36.2% moe_balance_loss=0.0214 expert_gini=0.0227 | |
| [2026-10-08T13:54:14Z step 1830024] loss=1.0517 lr=7.18859e-05 lr_phase=decay grad_norm=1.138 tokens/s=11.81M mfu=34.5% moe_balance_loss=0.0217 expert_gini=0.0233 | |
| [2026-10-08T13:54:21Z step 1830025] loss=1.0507 lr=7.18853e-05 lr_phase=decay grad_norm=1.319 tokens/s=12.20M mfu=35.6% moe_balance_loss=0.0215 expert_gini=0.0229 | |
| [2026-10-08T13:54:28Z step 1830026] loss=1.0438 lr=7.18846e-05 lr_phase=decay grad_norm=1.365 tokens/s=11.76M mfu=34.3% moe_balance_loss=0.0219 expert_gini=0.0241 | |
| [2026-10-08T13:54:36Z step 1830027] loss=1.0425 lr=7.18839e-05 lr_phase=decay grad_norm=1.282 tokens/s=10.89M mfu=31.8% moe_balance_loss=0.0216 expert_gini=0.0232 | |
| [2026-10-08T13:54:43Z step 1830028] loss=1.0478 lr=7.18833e-05 lr_phase=decay grad_norm=1.700 tokens/s=11.44M mfu=33.4% moe_balance_loss=0.0215 expert_gini=0.0227 | |
| [2026-10-08T13:54:50Z step 1830029] loss=1.0519 lr=7.18826e-05 lr_phase=decay grad_norm=1.215 tokens/s=11.73M mfu=34.3% moe_balance_loss=0.0218 expert_gini=0.0234 | |
| [2026-10-08T13:54:58Z step 1830030] loss=1.0460 lr=7.18820e-05 lr_phase=decay grad_norm=1.129 tokens/s=11.53M mfu=33.6% moe_balance_loss=0.0217 expert_gini=0.0233 | |
| [2026-10-08T13:55:05Z step 1830031] loss=1.0524 lr=7.18813e-05 lr_phase=decay grad_norm=1.553 tokens/s=11.37M mfu=33.2% moe_balance_loss=0.0215 expert_gini=0.0228 | |
| [2026-10-08T13:55:13Z step 1830032] loss=1.0548 lr=7.18806e-05 lr_phase=decay grad_norm=1.519 tokens/s=10.72M mfu=31.3% moe_balance_loss=0.0215 expert_gini=0.0227 | |
| [2026-10-08T13:55:21Z step 1830033] loss=1.0598 lr=7.18800e-05 lr_phase=decay grad_norm=1.567 tokens/s=10.75M mfu=31.4% moe_balance_loss=0.0214 expert_gini=0.0228 | |
| [2026-10-08T13:55:28Z step 1830034] loss=1.0628 lr=7.18793e-05 lr_phase=decay grad_norm=1.600 tokens/s=11.16M mfu=32.6% moe_balance_loss=0.0217 expert_gini=0.0232 | |
| [2026-10-08T13:55:36Z step 1830035] loss=1.0569 lr=7.18786e-05 lr_phase=decay grad_norm=1.593 tokens/s=11.46M mfu=33.4% moe_balance_loss=0.0220 expert_gini=0.0240 | |
| [2026-10-08T13:55:43Z step 1830036] loss=1.0632 lr=7.18780e-05 lr_phase=decay grad_norm=1.641 tokens/s=11.79M mfu=34.4% moe_balance_loss=0.0218 expert_gini=0.0232 | |
| [2026-10-08T13:55:50Z step 1830037] loss=1.0545 lr=7.18773e-05 lr_phase=decay grad_norm=1.512 tokens/s=11.35M mfu=33.1% moe_balance_loss=0.0214 expert_gini=0.0229 | |
| [2026-10-08T13:55:58Z step 1830038] loss=1.0635 lr=7.18766e-05 lr_phase=decay grad_norm=1.478 tokens/s=11.47M mfu=33.5% moe_balance_loss=0.0217 expert_gini=0.0239 | |
| [2026-10-08T13:56:05Z step 1830039] loss=1.0596 lr=7.18760e-05 lr_phase=decay grad_norm=1.334 tokens/s=11.55M mfu=33.7% moe_balance_loss=0.0222 expert_gini=0.0242 | |
| [2026-10-08T13:56:12Z step 1830040] loss=1.0509 lr=7.18753e-05 lr_phase=decay grad_norm=1.479 tokens/s=11.66M mfu=34.0% moe_balance_loss=0.0213 expert_gini=0.0228 | |
| [2026-10-08T13:56:20Z step 1830041] loss=1.0560 lr=7.18747e-05 lr_phase=decay grad_norm=1.491 tokens/s=11.31M mfu=33.0% moe_balance_loss=0.0214 expert_gini=0.0227 | |
| [2026-10-08T13:56:27Z step 1830042] loss=1.0500 lr=7.18740e-05 lr_phase=decay grad_norm=1.262 tokens/s=11.85M mfu=34.6% moe_balance_loss=0.0218 expert_gini=0.0233 | |
| [2026-10-08T13:56:34Z step 1830043] loss=1.0638 lr=7.18733e-05 lr_phase=decay grad_norm=1.472 tokens/s=11.51M mfu=33.6% moe_balance_loss=0.0219 expert_gini=0.0236 | |
| [2026-10-08T13:56:41Z step 1830044] loss=1.0557 lr=7.18727e-05 lr_phase=decay grad_norm=1.461 tokens/s=11.27M mfu=32.9% moe_balance_loss=0.0218 expert_gini=0.0232 | |
| [2026-10-08T13:56:48Z step 1830045] loss=1.0501 lr=7.18720e-05 lr_phase=decay grad_norm=1.491 tokens/s=11.32M mfu=33.0% moe_balance_loss=0.0214 expert_gini=0.0229 | |
| [2026-10-08T13:56:56Z step 1830046] loss=1.0571 lr=7.18713e-05 lr_phase=decay grad_norm=1.202 tokens/s=11.33M mfu=33.1% moe_balance_loss=0.0218 expert_gini=0.0236 | |
| [2026-10-08T13:57:03Z step 1830047] loss=1.0563 lr=7.18707e-05 lr_phase=decay grad_norm=1.286 tokens/s=11.44M mfu=33.4% moe_balance_loss=0.0216 expert_gini=0.0231 | |
| [2026-10-08T13:57:10Z step 1830048] loss=1.0553 lr=7.18700e-05 lr_phase=decay grad_norm=1.525 tokens/s=12.08M mfu=35.3% moe_balance_loss=0.0217 expert_gini=0.0234 | |
| [2026-10-08T13:57:16Z step 1830049] loss=1.0582 lr=7.18693e-05 lr_phase=decay grad_norm=1.531 tokens/s=12.78M mfu=37.3% moe_balance_loss=0.0217 expert_gini=0.0233 | |
| [2026-10-08T13:57:23Z step 1830050] loss=1.0577 lr=7.18687e-05 lr_phase=decay grad_norm=1.404 tokens/s=12.33M mfu=36.0% moe_balance_loss=0.0213 expert_gini=0.0228 | |
| [2026-10-08T13:57:23Z step 1830050] async checkpoint in 157.8s | |
| [2026-10-08T13:57:30Z step 1830051] loss=1.0523 lr=7.18680e-05 lr_phase=decay grad_norm=1.416 tokens/s=12.06M mfu=35.2% moe_balance_loss=0.0216 expert_gini=0.0229 | |
| [2026-10-08T13:57:36Z step 1830052] loss=1.0554 lr=7.18674e-05 lr_phase=decay grad_norm=1.571 tokens/s=12.80M mfu=37.4% moe_balance_loss=0.0216 expert_gini=0.0231 | |
| [2026-10-08T13:57:42Z step 1830053] loss=1.0611 lr=7.18667e-05 lr_phase=decay grad_norm=1.396 tokens/s=12.38M mfu=36.2% moe_balance_loss=0.0221 expert_gini=0.0236 | |
| [2026-10-08T13:57:49Z step 1830054] loss=1.0601 lr=7.18660e-05 lr_phase=decay grad_norm=1.670 tokens/s=12.11M mfu=35.3% moe_balance_loss=0.0212 expert_gini=0.0223 | |
| [2026-10-08T13:57:56Z step 1830055] loss=1.0555 lr=7.18654e-05 lr_phase=decay grad_norm=1.385 tokens/s=12.30M mfu=35.9% moe_balance_loss=0.0212 expert_gini=0.0224 | |
| [2026-10-08T13:58:03Z step 1830056] loss=1.0545 lr=7.18647e-05 lr_phase=decay grad_norm=1.267 tokens/s=11.81M mfu=34.5% moe_balance_loss=0.0213 expert_gini=0.0227 | |
| [2026-10-08T13:58:10Z step 1830057] loss=1.0551 lr=7.18640e-05 lr_phase=decay grad_norm=1.598 tokens/s=12.02M mfu=35.1% moe_balance_loss=0.0212 expert_gini=0.0223 | |
| [2026-10-08T13:58:18Z step 1830058] loss=1.0563 lr=7.18634e-05 lr_phase=decay grad_norm=1.644 tokens/s=11.58M mfu=33.8% moe_balance_loss=0.0217 expert_gini=0.0233 | |
| [2026-10-08T13:58:25Z step 1830059] loss=1.0467 lr=7.18627e-05 lr_phase=decay grad_norm=1.146 tokens/s=11.26M mfu=32.9% moe_balance_loss=0.0219 expert_gini=0.0233 | |
| [2026-10-08T13:58:33Z step 1830060] loss=1.0466 lr=7.18620e-05 lr_phase=decay grad_norm=1.213 tokens/s=10.85M mfu=31.7% moe_balance_loss=0.0216 expert_gini=0.0230 | |
| [2026-10-08T13:58:40Z step 1830061] loss=1.0460 lr=7.18614e-05 lr_phase=decay grad_norm=1.182 tokens/s=11.41M mfu=33.3% moe_balance_loss=0.0213 expert_gini=0.0226 | |
| [2026-10-08T13:58:47Z step 1830062] loss=1.0370 lr=7.18607e-05 lr_phase=decay grad_norm=1.044 tokens/s=12.69M mfu=37.1% moe_balance_loss=0.0215 expert_gini=0.0227 | |
| [2026-10-08T13:58:54Z step 1830063] loss=1.0462 lr=7.18601e-05 lr_phase=decay grad_norm=1.091 tokens/s=12.14M mfu=35.4% moe_balance_loss=0.0216 expert_gini=0.0232 | |
| [2026-10-08T13:59:01Z step 1830064] loss=1.0449 lr=7.18594e-05 lr_phase=decay grad_norm=1.274 tokens/s=12.10M mfu=35.3% moe_balance_loss=0.0217 expert_gini=0.0235 | |
| [2026-10-08T13:59:08Z step 1830065] loss=1.0487 lr=7.18587e-05 lr_phase=decay grad_norm=1.406 tokens/s=12.18M mfu=35.6% moe_balance_loss=0.0218 expert_gini=0.0233 | |
| [2026-10-08T13:59:15Z step 1830066] loss=1.0541 lr=7.18581e-05 lr_phase=decay grad_norm=1.220 tokens/s=12.09M mfu=35.3% moe_balance_loss=0.0215 expert_gini=0.0230 | |
| [2026-10-08T13:59:22Z step 1830067] loss=1.0511 lr=7.18574e-05 lr_phase=decay grad_norm=1.292 tokens/s=11.48M mfu=33.5% moe_balance_loss=0.0219 expert_gini=0.0236 | |
| [2026-10-08T13:59:30Z step 1830068] loss=1.0468 lr=7.18567e-05 lr_phase=decay grad_norm=1.467 tokens/s=11.69M mfu=34.1% moe_balance_loss=0.0216 expert_gini=0.0233 | |
| [2026-10-08T13:59:37Z step 1830069] loss=1.0431 lr=7.18561e-05 lr_phase=decay grad_norm=1.330 tokens/s=10.99M mfu=32.1% moe_balance_loss=0.0217 expert_gini=0.0231 | |
| [2026-10-08T13:59:45Z step 1830070] loss=1.0440 lr=7.18554e-05 lr_phase=decay grad_norm=1.326 tokens/s=11.51M mfu=33.6% moe_balance_loss=0.0221 expert_gini=0.0236 | |
| [2026-10-08T13:59:52Z step 1830071] loss=1.0509 lr=7.18547e-05 lr_phase=decay grad_norm=1.260 tokens/s=11.85M mfu=34.6% moe_balance_loss=0.0215 expert_gini=0.0229 | |
| [2026-10-08T13:59:59Z step 1830072] loss=1.0487 lr=7.18541e-05 lr_phase=decay grad_norm=1.568 tokens/s=11.51M mfu=33.6% moe_balance_loss=0.0217 expert_gini=0.0234 | |
| [2026-10-08T14:00:06Z step 1830073] loss=1.0476 lr=7.18534e-05 lr_phase=decay grad_norm=1.165 tokens/s=11.70M mfu=34.2% moe_balance_loss=0.0218 expert_gini=0.0234 | |
| [2026-10-08T14:00:14Z step 1830074] loss=1.0492 lr=7.18528e-05 lr_phase=decay grad_norm=1.037 tokens/s=11.18M mfu=32.6% moe_balance_loss=0.0216 expert_gini=0.0227 | |
| [2026-10-08T14:00:22Z step 1830075] loss=1.0465 lr=7.18521e-05 lr_phase=decay grad_norm=1.417 tokens/s=11.11M mfu=32.4% moe_balance_loss=0.0215 expert_gini=0.0226 | |
| [2026-10-08T14:00:29Z step 1830076] loss=1.0432 lr=7.18514e-05 lr_phase=decay grad_norm=1.125 tokens/s=11.78M mfu=34.4% moe_balance_loss=0.0217 expert_gini=0.0237 | |
| [2026-10-08T14:00:36Z step 1830077] loss=1.0359 lr=7.18508e-05 lr_phase=decay grad_norm=1.106 tokens/s=11.62M mfu=33.9% moe_balance_loss=0.0215 expert_gini=0.0232 | |
| [2026-10-08T14:00:43Z step 1830078] loss=1.0464 lr=7.18501e-05 lr_phase=decay grad_norm=1.249 tokens/s=11.64M mfu=34.0% moe_balance_loss=0.0215 expert_gini=0.0227 | |
| [2026-10-08T14:00:50Z step 1830079] loss=1.0571 lr=7.18494e-05 lr_phase=decay grad_norm=1.303 tokens/s=11.99M mfu=35.0% moe_balance_loss=0.0213 expert_gini=0.0230 | |
| [2026-10-08T14:00:57Z step 1830080] loss=1.0547 lr=7.18488e-05 lr_phase=decay grad_norm=1.826 tokens/s=12.16M mfu=35.5% moe_balance_loss=0.0212 expert_gini=0.0228 | |
| [2026-10-08T14:01:04Z step 1830081] loss=1.0535 lr=7.18481e-05 lr_phase=decay grad_norm=1.279 tokens/s=12.44M mfu=36.3% moe_balance_loss=0.0217 expert_gini=0.0233 | |
| [2026-10-08T14:01:11Z step 1830082] loss=1.0483 lr=7.18475e-05 lr_phase=decay grad_norm=0.926 tokens/s=12.53M mfu=36.6% moe_balance_loss=0.0219 expert_gini=0.0237 | |
| [2026-10-08T14:01:17Z step 1830083] loss=1.0554 lr=7.18468e-05 lr_phase=decay grad_norm=1.243 tokens/s=12.62M mfu=36.8% moe_balance_loss=0.0213 expert_gini=0.0226 | |
| [2026-10-08T14:01:24Z step 1830084] loss=1.0494 lr=7.18461e-05 lr_phase=decay grad_norm=1.074 tokens/s=12.33M mfu=36.0% moe_balance_loss=0.0217 expert_gini=0.0231 | |
| [2026-10-08T14:01:31Z step 1830085] loss=1.0490 lr=7.18455e-05 lr_phase=decay grad_norm=1.366 tokens/s=13.09M mfu=38.2% moe_balance_loss=0.0214 expert_gini=0.0230 | |
| [2026-10-08T14:01:38Z step 1830086] loss=1.0510 lr=7.18448e-05 lr_phase=decay grad_norm=1.358 tokens/s=12.72M mfu=37.1% moe_balance_loss=0.0215 expert_gini=0.0229 | |
| [2026-10-08T14:01:44Z step 1830087] loss=1.0509 lr=7.18441e-05 lr_phase=decay grad_norm=1.604 tokens/s=13.03M mfu=38.0% moe_balance_loss=0.0214 expert_gini=0.0228 | |
| [2026-10-08T14:01:51Z step 1830088] loss=1.0521 lr=7.18435e-05 lr_phase=decay grad_norm=1.498 tokens/s=12.54M mfu=36.6% moe_balance_loss=0.0222 expert_gini=0.0241 | |
| [2026-10-08T14:01:58Z step 1830089] loss=1.0474 lr=7.18428e-05 lr_phase=decay grad_norm=1.470 tokens/s=12.01M mfu=35.1% moe_balance_loss=0.0218 expert_gini=0.0236 | |
| [2026-10-08T14:02:05Z step 1830090] loss=1.0469 lr=7.18421e-05 lr_phase=decay grad_norm=1.316 tokens/s=12.34M mfu=36.0% moe_balance_loss=0.0213 expert_gini=0.0228 | |
| [2026-10-08T14:02:12Z step 1830091] loss=1.0517 lr=7.18415e-05 lr_phase=decay grad_norm=1.505 tokens/s=13.05M mfu=38.1% moe_balance_loss=0.0217 expert_gini=0.0235 | |
| [2026-10-08T14:02:18Z step 1830092] loss=1.0507 lr=7.18408e-05 lr_phase=decay grad_norm=1.078 tokens/s=12.27M mfu=35.8% moe_balance_loss=0.0217 expert_gini=0.0234 | |
| [2026-10-08T14:02:26Z step 1830093] loss=1.0481 lr=7.18402e-05 lr_phase=decay grad_norm=1.422 tokens/s=11.69M mfu=34.1% moe_balance_loss=0.0217 expert_gini=0.0237 | |
| [2026-10-08T14:02:33Z step 1830094] loss=1.0462 lr=7.18395e-05 lr_phase=decay grad_norm=1.235 tokens/s=12.12M mfu=35.4% moe_balance_loss=0.0219 expert_gini=0.0239 | |
| [2026-10-08T14:02:40Z step 1830095] loss=1.0398 lr=7.18388e-05 lr_phase=decay grad_norm=0.958 tokens/s=12.50M mfu=36.5% moe_balance_loss=0.0213 expert_gini=0.0226 | |
| [2026-10-08T14:02:46Z step 1830096] loss=1.0435 lr=7.18382e-05 lr_phase=decay grad_norm=0.974 tokens/s=12.96M mfu=37.8% moe_balance_loss=0.0219 expert_gini=0.0234 | |
| [2026-10-08T14:02:46Z step 1830096] eval(step 1830050). loss=1.1908 mmlu=0.8719(n=281) arc_challenge=0.7083(n=24) hellaswag=0.8806(n=201) eval_took=282s | |
| [2026-10-08T14:02:52Z step 1830097] loss=1.0441 lr=7.18375e-05 lr_phase=decay grad_norm=1.091 tokens/s=12.76M mfu=37.3% moe_balance_loss=0.0213 expert_gini=0.0228 | |
| [2026-10-08T14:02:59Z step 1830098] loss=1.0532 lr=7.18368e-05 lr_phase=decay grad_norm=1.357 tokens/s=12.82M mfu=37.4% moe_balance_loss=0.0214 expert_gini=0.0228 | |
| [2026-10-08T14:03:06Z step 1830099] loss=1.0549 lr=7.18362e-05 lr_phase=decay grad_norm=1.551 tokens/s=12.36M mfu=36.1% moe_balance_loss=0.0217 expert_gini=0.0235 | |
| [2026-10-08T14:03:12Z step 1830100] loss=1.0548 lr=7.18355e-05 lr_phase=decay grad_norm=1.230 tokens/s=12.86M mfu=37.6% moe_balance_loss=0.0213 expert_gini=0.0225 | |
| [2026-10-08T14:03:12Z step 1830100] async checkpoint in 174.6s | |
| [2026-10-08T14:03:19Z step 1830101] loss=1.0526 lr=7.18348e-05 lr_phase=decay grad_norm=1.524 tokens/s=12.24M mfu=35.7% moe_balance_loss=0.0220 expert_gini=0.0232 | |
| [2026-10-08T14:03:27Z step 1830102] loss=1.0603 lr=7.18342e-05 lr_phase=decay grad_norm=1.596 tokens/s=11.89M mfu=34.7% moe_balance_loss=0.0216 expert_gini=0.0228 | |
| [2026-10-08T14:03:33Z step 1830103] loss=1.0568 lr=7.18335e-05 lr_phase=decay grad_norm=1.556 tokens/s=12.16M mfu=35.5% moe_balance_loss=0.0216 expert_gini=0.0231 | |
| [2026-10-08T14:03:40Z step 1830104] loss=1.0566 lr=7.18329e-05 lr_phase=decay grad_norm=1.310 tokens/s=12.65M mfu=36.9% moe_balance_loss=0.0213 expert_gini=0.0227 | |
| [2026-10-08T14:03:47Z step 1830105] loss=1.0563 lr=7.18322e-05 lr_phase=decay grad_norm=1.747 tokens/s=12.20M mfu=35.6% moe_balance_loss=0.0216 expert_gini=0.0232 | |
| [2026-10-08T14:03:54Z step 1830106] loss=1.0498 lr=7.18315e-05 lr_phase=decay grad_norm=1.127 tokens/s=11.90M mfu=34.8% moe_balance_loss=0.0219 expert_gini=0.0235 | |
| [2026-10-08T14:04:01Z step 1830107] loss=1.0490 lr=7.18309e-05 lr_phase=decay grad_norm=1.361 tokens/s=12.35M mfu=36.1% moe_balance_loss=0.0216 expert_gini=0.0228 | |
| [2026-10-08T14:04:08Z step 1830108] loss=1.0474 lr=7.18302e-05 lr_phase=decay grad_norm=1.372 tokens/s=12.91M mfu=37.7% moe_balance_loss=0.0216 expert_gini=0.0233 | |
| [2026-10-08T14:04:15Z step 1830109] loss=1.0452 lr=7.18295e-05 lr_phase=decay grad_norm=1.404 tokens/s=13.03M mfu=38.0% moe_balance_loss=0.0216 expert_gini=0.0229 | |
| [2026-10-08T14:04:22Z step 1830110] loss=1.0445 lr=7.18289e-05 lr_phase=decay grad_norm=1.112 tokens/s=12.56M mfu=36.7% moe_balance_loss=0.0217 expert_gini=0.0230 | |
| [2026-10-08T14:04:28Z step 1830111] loss=1.0535 lr=7.18282e-05 lr_phase=decay grad_norm=1.687 tokens/s=12.77M mfu=37.3% moe_balance_loss=0.0217 expert_gini=0.0234 | |
| [2026-10-08T14:04:34Z step 1830112] loss=1.0527 lr=7.18275e-05 lr_phase=decay grad_norm=1.342 tokens/s=13.35M mfu=39.0% moe_balance_loss=0.0218 expert_gini=0.0231 | |
| [2026-10-08T14:04:41Z step 1830113] loss=1.0564 lr=7.18269e-05 lr_phase=decay grad_norm=1.597 tokens/s=12.86M mfu=37.5% moe_balance_loss=0.0215 expert_gini=0.0230 | |
| [2026-10-08T14:04:47Z step 1830114] loss=1.0441 lr=7.18262e-05 lr_phase=decay grad_norm=1.421 tokens/s=12.46M mfu=36.4% moe_balance_loss=0.0212 expert_gini=0.0227 | |
| [2026-10-08T14:04:54Z step 1830115] loss=1.0487 lr=7.18256e-05 lr_phase=decay grad_norm=1.203 tokens/s=12.70M mfu=37.1% moe_balance_loss=0.0221 expert_gini=0.0238 | |
| [2026-10-08T14:05:00Z step 1830116] loss=1.0480 lr=7.18249e-05 lr_phase=decay grad_norm=1.217 tokens/s=13.03M mfu=38.0% moe_balance_loss=0.0220 expert_gini=0.0235 | |
| [2026-10-08T14:05:07Z step 1830117] loss=1.0481 lr=7.18242e-05 lr_phase=decay grad_norm=1.087 tokens/s=12.79M mfu=37.3% moe_balance_loss=0.0216 expert_gini=0.0230 | |
| [2026-10-08T14:05:14Z step 1830118] loss=1.0495 lr=7.18236e-05 lr_phase=decay grad_norm=1.478 tokens/s=12.37M mfu=36.1% moe_balance_loss=0.0214 expert_gini=0.0229 | |
| [2026-10-08T14:05:20Z step 1830119] loss=1.0526 lr=7.18229e-05 lr_phase=decay grad_norm=1.552 tokens/s=12.92M mfu=37.7% moe_balance_loss=0.0215 expert_gini=0.0232 | |
| [2026-10-08T14:05:26Z step 1830120] loss=1.0566 lr=7.18222e-05 lr_phase=decay grad_norm=1.074 tokens/s=12.92M mfu=37.7% moe_balance_loss=0.0218 expert_gini=0.0234 | |
| [2026-10-08T14:05:33Z step 1830121] loss=1.0574 lr=7.18216e-05 lr_phase=decay grad_norm=1.225 tokens/s=12.59M mfu=36.8% moe_balance_loss=0.0218 expert_gini=0.0230 | |
| [2026-10-08T14:05:40Z step 1830122] loss=1.0538 lr=7.18209e-05 lr_phase=decay grad_norm=1.454 tokens/s=12.28M mfu=35.9% moe_balance_loss=0.0218 expert_gini=0.0236 | |
| [2026-10-08T14:05:46Z step 1830123] loss=1.0479 lr=7.18203e-05 lr_phase=decay grad_norm=1.335 tokens/s=12.79M mfu=37.3% moe_balance_loss=0.0218 expert_gini=0.0235 | |
| [2026-10-08T14:05:53Z step 1830124] loss=1.0560 lr=7.18196e-05 lr_phase=decay grad_norm=1.520 tokens/s=12.53M mfu=36.6% moe_balance_loss=0.0214 expert_gini=0.0234 | |
| [2026-10-08T14:06:00Z step 1830125] loss=1.0576 lr=7.18189e-05 lr_phase=decay grad_norm=1.668 tokens/s=12.67M mfu=37.0% moe_balance_loss=0.0216 expert_gini=0.0229 | |
| [2026-10-08T14:06:08Z step 1830126] loss=1.0557 lr=7.18183e-05 lr_phase=decay grad_norm=1.487 tokens/s=11.79M mfu=34.4% moe_balance_loss=0.0219 expert_gini=0.0238 | |
| [2026-10-08T14:06:14Z step 1830127] loss=1.0548 lr=7.18176e-05 lr_phase=decay grad_norm=1.266 tokens/s=11.97M mfu=34.9% moe_balance_loss=0.0219 expert_gini=0.0235 | |
| [2026-10-08T14:06:21Z step 1830128] loss=1.0500 lr=7.18169e-05 lr_phase=decay grad_norm=1.468 tokens/s=12.40M mfu=36.2% moe_balance_loss=0.0213 expert_gini=0.0230 | |
| [2026-10-08T14:06:29Z step 1830129] loss=1.0515 lr=7.18163e-05 lr_phase=decay grad_norm=1.620 tokens/s=12.03M mfu=35.1% moe_balance_loss=0.0217 expert_gini=0.0229 | |
| [2026-10-08T14:06:35Z step 1830130] loss=1.0518 lr=7.18156e-05 lr_phase=decay grad_norm=1.489 tokens/s=12.25M mfu=35.8% moe_balance_loss=0.0216 expert_gini=0.0230 | |
| [2026-10-08T14:06:42Z step 1830131] loss=1.0534 lr=7.18149e-05 lr_phase=decay grad_norm=1.466 tokens/s=12.13M mfu=35.4% moe_balance_loss=0.0217 expert_gini=0.0235 | |
| [2026-10-08T14:06:49Z step 1830132] loss=1.0535 lr=7.18143e-05 lr_phase=decay grad_norm=1.531 tokens/s=12.01M mfu=35.1% moe_balance_loss=0.0217 expert_gini=0.0229 | |
| [2026-10-08T14:06:56Z step 1830133] loss=1.0507 lr=7.18136e-05 lr_phase=decay grad_norm=1.054 tokens/s=12.39M mfu=36.2% moe_balance_loss=0.0212 expert_gini=0.0227 | |
| [2026-10-08T14:07:03Z step 1830134] loss=1.0491 lr=7.18130e-05 lr_phase=decay grad_norm=1.440 tokens/s=11.76M mfu=34.3% moe_balance_loss=0.0215 expert_gini=0.0228 | |
| [2026-10-08T14:07:10Z step 1830135] loss=1.0537 lr=7.18123e-05 lr_phase=decay grad_norm=1.496 tokens/s=11.95M mfu=34.9% moe_balance_loss=0.0219 expert_gini=0.0235 | |
| [2026-10-08T14:07:16Z step 1830136] loss=1.0494 lr=7.18116e-05 lr_phase=decay grad_norm=1.306 tokens/s=12.79M mfu=37.3% moe_balance_loss=0.0216 expert_gini=0.0231 | |
| [2026-10-08T14:07:23Z step 1830137] loss=1.0498 lr=7.18110e-05 lr_phase=decay grad_norm=1.305 tokens/s=13.26M mfu=38.7% moe_balance_loss=0.0214 expert_gini=0.0230 | |
| [2026-10-08T14:07:29Z step 1830138] loss=1.0483 lr=7.18103e-05 lr_phase=decay grad_norm=1.147 tokens/s=13.41M mfu=39.1% moe_balance_loss=0.0213 expert_gini=0.0228 | |
| [2026-10-08T14:07:36Z step 1830139] loss=1.0515 lr=7.18096e-05 lr_phase=decay grad_norm=1.682 tokens/s=12.77M mfu=37.3% moe_balance_loss=0.0217 expert_gini=0.0230 | |
| [2026-10-08T14:07:42Z step 1830140] loss=1.0561 lr=7.18090e-05 lr_phase=decay grad_norm=1.534 tokens/s=13.36M mfu=39.0% moe_balance_loss=0.0218 expert_gini=0.0235 | |
| [2026-10-08T14:07:48Z step 1830141] loss=1.0565 lr=7.18083e-05 lr_phase=decay grad_norm=1.214 tokens/s=13.09M mfu=38.2% moe_balance_loss=0.0218 expert_gini=0.0234 | |
| [2026-10-08T14:07:54Z step 1830142] loss=1.0586 lr=7.18076e-05 lr_phase=decay grad_norm=1.371 tokens/s=13.45M mfu=39.3% moe_balance_loss=0.0217 expert_gini=0.0235 | |
| [2026-10-08T14:08:01Z step 1830143] loss=1.0578 lr=7.18070e-05 lr_phase=decay grad_norm=1.396 tokens/s=12.90M mfu=37.7% moe_balance_loss=0.0213 expert_gini=0.0229 | |
| [2026-10-08T14:08:07Z step 1830144] loss=1.0536 lr=7.18063e-05 lr_phase=decay grad_norm=1.289 tokens/s=12.57M mfu=36.7% moe_balance_loss=0.0214 expert_gini=0.0226 | |
| [2026-10-08T14:08:14Z step 1830145] loss=1.0571 lr=7.18057e-05 lr_phase=decay grad_norm=1.300 tokens/s=13.06M mfu=38.1% moe_balance_loss=0.0216 expert_gini=0.0233 | |
| [2026-10-08T14:08:14Z step 1830145] eval(step 1830100). loss=1.1911 mmlu=0.8790(n=281) arc_challenge=0.7083(n=24) hellaswag=0.8806(n=201) eval_took=277s | |
| [2026-10-08T14:08:20Z step 1830146] loss=1.0490 lr=7.18050e-05 lr_phase=decay grad_norm=1.148 tokens/s=13.55M mfu=39.6% moe_balance_loss=0.0215 expert_gini=0.0231 | |
| [2026-10-08T14:08:26Z step 1830147] loss=1.0544 lr=7.18043e-05 lr_phase=decay grad_norm=1.339 tokens/s=12.92M mfu=37.7% moe_balance_loss=0.0219 expert_gini=0.0237 | |
| [2026-10-08T14:08:33Z step 1830148] loss=1.0450 lr=7.18037e-05 lr_phase=decay grad_norm=1.390 tokens/s=12.81M mfu=37.4% moe_balance_loss=0.0215 expert_gini=0.0231 | |
| [2026-10-08T14:08:40Z step 1830149] loss=1.0533 lr=7.18030e-05 lr_phase=decay grad_norm=1.351 tokens/s=12.59M mfu=36.8% moe_balance_loss=0.0217 expert_gini=0.0237 | |
| [2026-10-08T14:08:46Z step 1830150] loss=1.0479 lr=7.18023e-05 lr_phase=decay grad_norm=1.389 tokens/s=12.40M mfu=36.2% moe_balance_loss=0.0216 expert_gini=0.0234 | |
| [2026-10-08T14:08:46Z step 1830150] async checkpoint in 196.4s | |
| [2026-10-08T14:08:53Z step 1830151] loss=1.0528 lr=7.18017e-05 lr_phase=decay grad_norm=1.287 tokens/s=12.41M mfu=36.2% moe_balance_loss=0.0216 expert_gini=0.0233 | |
| [2026-10-08T14:09:00Z step 1830152] loss=1.0612 lr=7.18010e-05 lr_phase=decay grad_norm=1.485 tokens/s=12.54M mfu=36.6% moe_balance_loss=0.0216 expert_gini=0.0232 | |
| [2026-10-08T14:09:07Z step 1830153] loss=1.0503 lr=7.18003e-05 lr_phase=decay grad_norm=1.192 tokens/s=12.58M mfu=36.7% moe_balance_loss=0.0215 expert_gini=0.0232 | |
| [2026-10-08T14:09:14Z step 1830154] loss=1.0587 lr=7.17997e-05 lr_phase=decay grad_norm=1.415 tokens/s=12.27M mfu=35.8% moe_balance_loss=0.0218 expert_gini=0.0234 | |
| [2026-10-08T14:09:21Z step 1830155] loss=1.0565 lr=7.17990e-05 lr_phase=decay grad_norm=1.599 tokens/s=11.38M mfu=33.2% moe_balance_loss=0.0217 expert_gini=0.0230 | |
| [2026-10-08T14:09:28Z step 1830156] loss=1.0536 lr=7.17984e-05 lr_phase=decay grad_norm=1.490 tokens/s=11.37M mfu=33.2% moe_balance_loss=0.0216 expert_gini=0.0232 | |
| [2026-10-08T14:09:36Z step 1830157] loss=1.0570 lr=7.17977e-05 lr_phase=decay grad_norm=1.528 tokens/s=11.41M mfu=33.3% moe_balance_loss=0.0214 expert_gini=0.0227 | |
| [2026-10-08T14:09:43Z step 1830158] loss=1.0557 lr=7.17970e-05 lr_phase=decay grad_norm=1.580 tokens/s=11.52M mfu=33.6% moe_balance_loss=0.0215 expert_gini=0.0232 | |
| [2026-10-08T14:09:50Z step 1830159] loss=1.0544 lr=7.17964e-05 lr_phase=decay grad_norm=1.114 tokens/s=12.32M mfu=36.0% moe_balance_loss=0.0214 expert_gini=0.0225 | |
| [2026-10-08T14:09:58Z step 1830160] loss=1.0475 lr=7.17957e-05 lr_phase=decay grad_norm=1.463 tokens/s=11.54M mfu=33.7% moe_balance_loss=0.0215 expert_gini=0.0229 | |
| [2026-10-08T14:10:05Z step 1830161] loss=1.0606 lr=7.17950e-05 lr_phase=decay grad_norm=1.565 tokens/s=11.17M mfu=32.6% moe_balance_loss=0.0213 expert_gini=0.0226 | |
| [2026-10-08T14:10:13Z step 1830162] loss=1.0548 lr=7.17944e-05 lr_phase=decay grad_norm=1.454 tokens/s=11.39M mfu=33.3% moe_balance_loss=0.0219 expert_gini=0.0235 | |
| [2026-10-08T14:10:20Z step 1830163] loss=1.0583 lr=7.17937e-05 lr_phase=decay grad_norm=1.226 tokens/s=11.23M mfu=32.8% moe_balance_loss=0.0216 expert_gini=0.0229 | |
| [2026-10-08T14:10:28Z step 1830164] loss=1.0554 lr=7.17930e-05 lr_phase=decay grad_norm=1.354 tokens/s=11.00M mfu=32.1% moe_balance_loss=0.0217 expert_gini=0.0233 | |
| [2026-10-08T14:10:35Z step 1830165] loss=1.0575 lr=7.17924e-05 lr_phase=decay grad_norm=1.497 tokens/s=11.21M mfu=32.7% moe_balance_loss=0.0215 expert_gini=0.0229 | |
| [2026-10-08T14:10:43Z step 1830166] loss=1.0623 lr=7.17917e-05 lr_phase=decay grad_norm=1.494 tokens/s=11.45M mfu=33.4% moe_balance_loss=0.0213 expert_gini=0.0226 | |
| [2026-10-08T14:10:50Z step 1830167] loss=1.0528 lr=7.17911e-05 lr_phase=decay grad_norm=1.376 tokens/s=12.32M mfu=36.0% moe_balance_loss=0.0217 expert_gini=0.0233 | |
| [2026-10-08T14:10:56Z step 1830168] loss=1.0552 lr=7.17904e-05 lr_phase=decay grad_norm=1.690 tokens/s=13.24M mfu=38.7% moe_balance_loss=0.0214 expert_gini=0.0231 | |
| [2026-10-08T14:11:03Z step 1830169] loss=1.0514 lr=7.17897e-05 lr_phase=decay grad_norm=1.849 tokens/s=13.59M mfu=39.7% moe_balance_loss=0.0215 expert_gini=0.0229 | |
| [2026-10-08T14:11:09Z step 1830170] loss=1.0386 lr=7.17891e-05 lr_phase=decay grad_norm=1.104 tokens/s=13.05M mfu=38.1% moe_balance_loss=0.0218 expert_gini=0.0233 | |
| [2026-10-08T14:11:16Z step 1830171] loss=1.0453 lr=7.17884e-05 lr_phase=decay grad_norm=1.182 tokens/s=12.21M mfu=35.6% moe_balance_loss=0.0216 expert_gini=0.0232 | |
| [2026-10-08T14:11:23Z step 1830172] loss=1.0505 lr=7.17877e-05 lr_phase=decay grad_norm=1.387 tokens/s=11.62M mfu=33.9% moe_balance_loss=0.0212 expert_gini=0.0228 | |
| [2026-10-08T14:11:30Z step 1830173] loss=1.0520 lr=7.17871e-05 lr_phase=decay grad_norm=1.386 tokens/s=11.77M mfu=34.3% moe_balance_loss=0.0215 expert_gini=0.0228 | |
| [2026-10-08T14:11:38Z step 1830174] loss=1.0499 lr=7.17864e-05 lr_phase=decay grad_norm=1.330 tokens/s=11.81M mfu=34.5% moe_balance_loss=0.0214 expert_gini=0.0230 | |
| [2026-10-08T14:11:45Z step 1830175] loss=1.0545 lr=7.17858e-05 lr_phase=decay grad_norm=1.461 tokens/s=11.99M mfu=35.0% moe_balance_loss=0.0215 expert_gini=0.0229 | |
| [2026-10-08T14:11:52Z step 1830176] loss=1.0494 lr=7.17851e-05 lr_phase=decay grad_norm=1.397 tokens/s=11.83M mfu=34.5% moe_balance_loss=0.0214 expert_gini=0.0225 | |
| [2026-10-08T14:11:59Z step 1830177] loss=1.0511 lr=7.17844e-05 lr_phase=decay grad_norm=1.353 tokens/s=11.95M mfu=34.9% moe_balance_loss=0.0216 expert_gini=0.0235 | |
| [2026-10-08T14:12:06Z step 1830178] loss=1.0571 lr=7.17838e-05 lr_phase=decay grad_norm=1.410 tokens/s=11.45M mfu=33.4% moe_balance_loss=0.0217 expert_gini=0.0232 | |
| [2026-10-08T14:12:14Z step 1830179] loss=1.0564 lr=7.17831e-05 lr_phase=decay grad_norm=1.359 tokens/s=11.46M mfu=33.5% moe_balance_loss=0.0218 expert_gini=0.0237 | |
| [2026-10-08T14:12:22Z step 1830180] loss=1.0530 lr=7.17824e-05 lr_phase=decay grad_norm=1.395 tokens/s=10.93M mfu=31.9% moe_balance_loss=0.0217 expert_gini=0.0236 | |
| [2026-10-08T14:12:30Z step 1830181] loss=1.0515 lr=7.17818e-05 lr_phase=decay grad_norm=1.256 tokens/s=10.51M mfu=30.7% moe_balance_loss=0.0219 expert_gini=0.0234 | |
| [2026-10-08T14:12:37Z step 1830182] loss=1.0530 lr=7.17811e-05 lr_phase=decay grad_norm=1.567 tokens/s=11.07M mfu=32.3% moe_balance_loss=0.0219 expert_gini=0.0235 | |
| [2026-10-08T14:12:45Z step 1830183] loss=1.0514 lr=7.17804e-05 lr_phase=decay grad_norm=1.314 tokens/s=11.01M mfu=32.2% moe_balance_loss=0.0215 expert_gini=0.0232 | |
| [2026-10-08T14:12:52Z step 1830184] loss=1.0471 lr=7.17798e-05 lr_phase=decay grad_norm=1.128 tokens/s=10.68M mfu=31.2% moe_balance_loss=0.0215 expert_gini=0.0231 | |
| [2026-10-08T14:12:59Z step 1830185] loss=1.0488 lr=7.17791e-05 lr_phase=decay grad_norm=1.277 tokens/s=11.45M mfu=33.4% moe_balance_loss=0.0220 expert_gini=0.0235 | |
| [2026-10-08T14:13:07Z step 1830186] loss=1.0554 lr=7.17785e-05 lr_phase=decay grad_norm=1.445 tokens/s=11.71M mfu=34.2% moe_balance_loss=0.0216 expert_gini=0.0229 | |
| [2026-10-08T14:13:14Z step 1830187] loss=1.0552 lr=7.17778e-05 lr_phase=decay grad_norm=1.315 tokens/s=11.90M mfu=34.7% moe_balance_loss=0.0214 expert_gini=0.0228 | |
| [2026-10-08T14:13:21Z step 1830188] loss=1.0512 lr=7.17771e-05 lr_phase=decay grad_norm=1.225 tokens/s=11.81M mfu=34.5% moe_balance_loss=0.0219 expert_gini=0.0233 | |
| [2026-10-08T14:13:28Z step 1830189] loss=1.0499 lr=7.17765e-05 lr_phase=decay grad_norm=1.631 tokens/s=12.25M mfu=35.8% moe_balance_loss=0.0216 expert_gini=0.0230 | |
| [2026-10-08T14:13:34Z step 1830190] loss=1.0451 lr=7.17758e-05 lr_phase=decay grad_norm=1.045 tokens/s=12.85M mfu=37.5% moe_balance_loss=0.0212 expert_gini=0.0225 | |
| [2026-10-08T14:13:41Z step 1830191] loss=1.0544 lr=7.17751e-05 lr_phase=decay grad_norm=1.406 tokens/s=13.25M mfu=38.7% moe_balance_loss=0.0217 expert_gini=0.0233 | |
| [2026-10-08T14:13:47Z step 1830192] loss=1.0553 lr=7.17745e-05 lr_phase=decay grad_norm=1.328 tokens/s=12.76M mfu=37.2% moe_balance_loss=0.0214 expert_gini=0.0231 | |
| [2026-10-08T14:13:47Z step 1830192] eval(step 1830150). loss=1.1896 mmlu=0.8790(n=281) arc_challenge=0.7083(n=24) hellaswag=0.8905(n=201) eval_took=240s | |
| [2026-10-08T14:13:54Z step 1830193] loss=1.0562 lr=7.17738e-05 lr_phase=decay grad_norm=1.422 tokens/s=12.84M mfu=37.5% moe_balance_loss=0.0215 expert_gini=0.0230 | |
| [2026-10-08T14:14:00Z step 1830194] loss=1.0523 lr=7.17731e-05 lr_phase=decay grad_norm=1.500 tokens/s=12.56M mfu=36.7% moe_balance_loss=0.0213 expert_gini=0.0227 | |
| [2026-10-08T14:14:07Z step 1830195] loss=1.0537 lr=7.17725e-05 lr_phase=decay grad_norm=1.560 tokens/s=12.59M mfu=36.7% moe_balance_loss=0.0217 expert_gini=0.0233 | |
| [2026-10-08T14:14:14Z step 1830196] loss=1.0540 lr=7.17718e-05 lr_phase=decay grad_norm=1.278 tokens/s=12.71M mfu=37.1% moe_balance_loss=0.0215 expert_gini=0.0230 | |
| [2026-10-08T14:14:21Z step 1830197] loss=1.0567 lr=7.17712e-05 lr_phase=decay grad_norm=1.474 tokens/s=11.78M mfu=34.4% moe_balance_loss=0.0215 expert_gini=0.0230 | |
| [2026-10-08T14:14:28Z step 1830198] loss=1.0538 lr=7.17705e-05 lr_phase=decay grad_norm=1.302 tokens/s=11.63M mfu=33.9% moe_balance_loss=0.0215 expert_gini=0.0229 | |
| [2026-10-08T14:14:35Z step 1830199] loss=1.0570 lr=7.17698e-05 lr_phase=decay grad_norm=1.387 tokens/s=11.51M mfu=33.6% moe_balance_loss=0.0219 expert_gini=0.0237 | |
| [2026-10-08T14:14:43Z step 1830200] loss=1.0567 lr=7.17692e-05 lr_phase=decay grad_norm=1.302 tokens/s=11.54M mfu=33.7% moe_balance_loss=0.0214 expert_gini=0.0227 | |
| [2026-10-08T14:14:43Z step 1830200] async checkpoint in 160.5s | |
| [2026-10-08T14:14:50Z step 1830201] loss=1.0549 lr=7.17685e-05 lr_phase=decay grad_norm=1.424 tokens/s=11.84M mfu=34.6% moe_balance_loss=0.0213 expert_gini=0.0228 | |
| [2026-10-08T14:14:57Z step 1830202] loss=1.0498 lr=7.17678e-05 lr_phase=decay grad_norm=1.427 tokens/s=11.88M mfu=34.7% moe_balance_loss=0.0213 expert_gini=0.0222 | |
| [2026-10-08T14:15:04Z step 1830203] loss=1.0430 lr=7.17672e-05 lr_phase=decay grad_norm=1.226 tokens/s=12.08M mfu=35.3% moe_balance_loss=0.0221 expert_gini=0.0238 | |
| [2026-10-08T14:15:11Z step 1830204] loss=1.0464 lr=7.17665e-05 lr_phase=decay grad_norm=1.108 tokens/s=12.86M mfu=37.6% moe_balance_loss=0.0217 expert_gini=0.0233 | |
| [2026-10-08T14:15:17Z step 1830205] loss=1.0542 lr=7.17658e-05 lr_phase=decay grad_norm=1.475 tokens/s=12.52M mfu=36.6% moe_balance_loss=0.0216 expert_gini=0.0232 | |
| [2026-10-08T14:15:24Z step 1830206] loss=1.0488 lr=7.17652e-05 lr_phase=decay grad_norm=1.429 tokens/s=12.96M mfu=37.8% moe_balance_loss=0.0217 expert_gini=0.0233 | |
| [2026-10-08T14:15:31Z step 1830207] loss=1.0499 lr=7.17645e-05 lr_phase=decay grad_norm=1.086 tokens/s=12.58M mfu=36.7% moe_balance_loss=0.0216 expert_gini=0.0232 | |
| [2026-10-08T14:15:38Z step 1830208] loss=1.0468 lr=7.17639e-05 lr_phase=decay grad_norm=1.183 tokens/s=12.59M mfu=36.8% moe_balance_loss=0.0219 expert_gini=0.0236 | |
| [2026-10-08T14:15:44Z step 1830209] loss=1.0485 lr=7.17632e-05 lr_phase=decay grad_norm=1.338 tokens/s=13.27M mfu=38.7% moe_balance_loss=0.0219 expert_gini=0.0238 | |
| [2026-10-08T14:15:50Z step 1830210] loss=1.0465 lr=7.17625e-05 lr_phase=decay grad_norm=1.254 tokens/s=13.45M mfu=39.3% moe_balance_loss=0.0213 expert_gini=0.0227 | |
| [2026-10-08T14:15:57Z step 1830211] loss=1.0434 lr=7.17619e-05 lr_phase=decay grad_norm=1.132 tokens/s=13.03M mfu=38.1% moe_balance_loss=0.0212 expert_gini=0.0223 | |
| [2026-10-08T14:16:04Z step 1830212] loss=1.0478 lr=7.17612e-05 lr_phase=decay grad_norm=1.274 tokens/s=12.58M mfu=36.7% moe_balance_loss=0.0216 expert_gini=0.0230 | |
| [2026-10-08T14:16:10Z step 1830213] loss=1.0495 lr=7.17605e-05 lr_phase=decay grad_norm=1.414 tokens/s=12.46M mfu=36.4% moe_balance_loss=0.0218 expert_gini=0.0231 | |
| [2026-10-08T14:16:17Z step 1830214] loss=1.0498 lr=7.17599e-05 lr_phase=decay grad_norm=1.476 tokens/s=12.40M mfu=36.2% moe_balance_loss=0.0217 expert_gini=0.0232 | |
| [2026-10-08T14:16:23Z step 1830215] loss=1.0509 lr=7.17592e-05 lr_phase=decay grad_norm=1.472 tokens/s=12.97M mfu=37.9% moe_balance_loss=0.0215 expert_gini=0.0229 | |
| [2026-10-08T14:16:30Z step 1830216] loss=1.0521 lr=7.17586e-05 lr_phase=decay grad_norm=1.471 tokens/s=12.62M mfu=36.8% moe_balance_loss=0.0218 expert_gini=0.0235 | |
| [2026-10-08T14:16:37Z step 1830217] loss=1.0471 lr=7.17579e-05 lr_phase=decay grad_norm=1.483 tokens/s=12.71M mfu=37.1% moe_balance_loss=0.0213 expert_gini=0.0226 | |
| [2026-10-08T14:16:43Z step 1830218] loss=1.0577 lr=7.17572e-05 lr_phase=decay grad_norm=1.287 tokens/s=12.61M mfu=36.8% moe_balance_loss=0.0217 expert_gini=0.0233 | |
| [2026-10-08T14:16:50Z step 1830219] loss=1.0557 lr=7.17566e-05 lr_phase=decay grad_norm=1.420 tokens/s=12.37M mfu=36.1% moe_balance_loss=0.0216 expert_gini=0.0235 | |
| [2026-10-08T14:16:57Z step 1830220] loss=1.0462 lr=7.17559e-05 lr_phase=decay grad_norm=1.455 tokens/s=12.31M mfu=36.0% moe_balance_loss=0.0213 expert_gini=0.0224 | |
| [2026-10-08T14:17:04Z step 1830221] loss=1.0495 lr=7.17552e-05 lr_phase=decay grad_norm=1.334 tokens/s=12.09M mfu=35.3% moe_balance_loss=0.0213 expert_gini=0.0225 | |
| [2026-10-08T14:17:12Z step 1830222] loss=1.0470 lr=7.17546e-05 lr_phase=decay grad_norm=1.271 tokens/s=11.82M mfu=34.5% moe_balance_loss=0.0213 expert_gini=0.0227 | |
| [2026-10-08T14:17:19Z step 1830223] loss=1.0517 lr=7.17539e-05 lr_phase=decay grad_norm=1.286 tokens/s=11.84M mfu=34.6% moe_balance_loss=0.0215 expert_gini=0.0233 | |
| [2026-10-08T14:17:25Z step 1830224] loss=1.0558 lr=7.17532e-05 lr_phase=decay grad_norm=1.400 tokens/s=12.47M mfu=36.4% moe_balance_loss=0.0221 expert_gini=0.0239 | |
| [2026-10-08T14:17:32Z step 1830225] loss=1.0585 lr=7.17526e-05 lr_phase=decay grad_norm=1.410 tokens/s=12.31M mfu=35.9% moe_balance_loss=0.0215 expert_gini=0.0231 | |
| [2026-10-08T14:17:39Z step 1830226] loss=1.0606 lr=7.17519e-05 lr_phase=decay grad_norm=1.445 tokens/s=12.94M mfu=37.8% moe_balance_loss=0.0215 expert_gini=0.0231 | |
| [2026-10-08T14:17:45Z step 1830227] loss=1.0587 lr=7.17513e-05 lr_phase=decay grad_norm=1.173 tokens/s=13.63M mfu=39.8% moe_balance_loss=0.0217 expert_gini=0.0228 | |
| [2026-10-08T14:17:52Z step 1830228] loss=1.0463 lr=7.17506e-05 lr_phase=decay grad_norm=1.365 tokens/s=13.42M mfu=39.2% moe_balance_loss=0.0217 expert_gini=0.0232 | |
| [2026-10-08T14:17:58Z step 1830229] loss=1.0594 lr=7.17499e-05 lr_phase=decay grad_norm=1.299 tokens/s=13.10M mfu=38.2% moe_balance_loss=0.0216 expert_gini=0.0230 | |
| [2026-10-08T14:18:05Z step 1830230] loss=1.0472 lr=7.17493e-05 lr_phase=decay grad_norm=1.421 tokens/s=13.34M mfu=38.9% moe_balance_loss=0.0217 expert_gini=0.0235 | |
| [2026-10-08T14:18:11Z step 1830231] loss=1.0577 lr=7.17486e-05 lr_phase=decay grad_norm=1.529 tokens/s=13.19M mfu=38.5% moe_balance_loss=0.0216 expert_gini=0.0235 | |
| [2026-10-08T14:18:18Z step 1830232] loss=1.0501 lr=7.17479e-05 lr_phase=decay grad_norm=1.529 tokens/s=12.67M mfu=37.0% moe_balance_loss=0.0213 expert_gini=0.0229 | |
| [2026-10-08T14:18:24Z step 1830233] loss=1.0557 lr=7.17473e-05 lr_phase=decay grad_norm=1.491 tokens/s=12.62M mfu=36.8% moe_balance_loss=0.0221 expert_gini=0.0236 | |
| [2026-10-08T14:18:31Z step 1830234] loss=1.0511 lr=7.17466e-05 lr_phase=decay grad_norm=1.383 tokens/s=12.44M mfu=36.3% moe_balance_loss=0.0216 expert_gini=0.0232 | |
| [2026-10-08T14:18:38Z step 1830235] loss=1.0506 lr=7.17459e-05 lr_phase=decay grad_norm=1.128 tokens/s=12.44M mfu=36.3% moe_balance_loss=0.0217 expert_gini=0.0235 | |
| [2026-10-08T14:18:45Z step 1830236] loss=1.0493 lr=7.17453e-05 lr_phase=decay grad_norm=1.062 tokens/s=12.29M mfu=35.9% moe_balance_loss=0.0215 expert_gini=0.0226 | |
| [2026-10-08T14:18:52Z step 1830237] loss=1.0499 lr=7.17446e-05 lr_phase=decay grad_norm=1.233 tokens/s=12.37M mfu=36.1% moe_balance_loss=0.0220 expert_gini=0.0238 | |
| [2026-10-08T14:18:59Z step 1830238] loss=1.0433 lr=7.17440e-05 lr_phase=decay grad_norm=1.180 tokens/s=11.64M mfu=34.0% moe_balance_loss=0.0216 expert_gini=0.0233 | |
| [2026-10-08T14:19:06Z step 1830239] loss=1.0548 lr=7.17433e-05 lr_phase=decay grad_norm=1.181 tokens/s=11.50M mfu=33.6% moe_balance_loss=0.0212 expert_gini=0.0225 | |
| [2026-10-08T14:19:14Z step 1830240] loss=1.0527 lr=7.17426e-05 lr_phase=decay grad_norm=1.590 tokens/s=11.39M mfu=33.2% moe_balance_loss=0.0219 expert_gini=0.0234 | |
| [2026-10-08T14:19:21Z step 1830241] loss=1.0512 lr=7.17420e-05 lr_phase=decay grad_norm=1.452 tokens/s=11.81M mfu=34.5% moe_balance_loss=0.0217 expert_gini=0.0234 | |
| [2026-10-08T14:19:28Z step 1830242] loss=1.0649 lr=7.17413e-05 lr_phase=decay grad_norm=1.349 tokens/s=12.36M mfu=36.1% moe_balance_loss=0.0216 expert_gini=0.0231 | |
| [2026-10-08T14:19:35Z step 1830243] loss=1.0582 lr=7.17406e-05 lr_phase=decay grad_norm=1.666 tokens/s=12.25M mfu=35.8% moe_balance_loss=0.0216 expert_gini=0.0231 | |
| [2026-10-08T14:19:42Z step 1830244] loss=1.0544 lr=7.17400e-05 lr_phase=decay grad_norm=1.610 tokens/s=12.04M mfu=35.2% moe_balance_loss=0.0212 expert_gini=0.0229 | |
| [2026-10-08T14:19:49Z step 1830245] loss=1.0532 lr=7.17393e-05 lr_phase=decay grad_norm=1.334 tokens/s=12.35M mfu=36.1% moe_balance_loss=0.0215 expert_gini=0.0229 | |
| [2026-10-08T14:19:49Z step 1830245] eval(step 1830200). loss=1.1909 mmlu=0.8826(n=281) arc_challenge=0.7083(n=24) hellaswag=0.8905(n=201) eval_took=273s | |
| [2026-10-08T14:19:55Z step 1830246] loss=1.0581 lr=7.17386e-05 lr_phase=decay grad_norm=1.493 tokens/s=12.48M mfu=36.4% moe_balance_loss=0.0219 expert_gini=0.0234 | |
| [2026-10-08T14:20:01Z step 1830247] loss=1.0545 lr=7.17380e-05 lr_phase=decay grad_norm=1.353 tokens/s=13.04M mfu=38.1% moe_balance_loss=0.0217 expert_gini=0.0231 | |
| [2026-10-08T14:20:08Z step 1830248] loss=1.0505 lr=7.17373e-05 lr_phase=decay grad_norm=1.369 tokens/s=12.79M mfu=37.3% moe_balance_loss=0.0215 expert_gini=0.0229 | |
| [2026-10-08T14:20:15Z step 1830249] loss=1.0570 lr=7.17367e-05 lr_phase=decay grad_norm=1.988 tokens/s=12.76M mfu=37.3% moe_balance_loss=0.0217 expert_gini=0.0228 | |
| [2026-10-08T14:20:22Z step 1830250] loss=1.0515 lr=7.17360e-05 lr_phase=decay grad_norm=1.492 tokens/s=12.45M mfu=36.4% moe_balance_loss=0.0218 expert_gini=0.0232 | |
| [2026-10-08T14:20:22Z step 1830250] async checkpoint in 172.8s | |
| [2026-10-08T14:20:28Z step 1830251] loss=1.0533 lr=7.17353e-05 lr_phase=decay grad_norm=1.433 tokens/s=12.54M mfu=36.6% moe_balance_loss=0.0216 expert_gini=0.0232 | |
| [2026-10-08T14:20:35Z step 1830252] loss=1.0425 lr=7.17347e-05 lr_phase=decay grad_norm=1.450 tokens/s=13.06M mfu=38.1% moe_balance_loss=0.0212 expert_gini=0.0225 | |
| [2026-10-08T14:20:41Z step 1830253] loss=1.0507 lr=7.17340e-05 lr_phase=decay grad_norm=1.710 tokens/s=13.19M mfu=38.5% moe_balance_loss=0.0214 expert_gini=0.0228 | |
| [2026-10-08T14:20:48Z step 1830254] loss=1.0546 lr=7.17333e-05 lr_phase=decay grad_norm=1.188 tokens/s=13.17M mfu=38.4% moe_balance_loss=0.0216 expert_gini=0.0231 | |
| [2026-10-08T14:20:54Z step 1830255] loss=1.0501 lr=7.17327e-05 lr_phase=decay grad_norm=1.524 tokens/s=13.05M mfu=38.1% moe_balance_loss=0.0218 expert_gini=0.0233 | |
| [2026-10-08T14:21:01Z step 1830256] loss=1.0547 lr=7.17320e-05 lr_phase=decay grad_norm=1.462 tokens/s=13.00M mfu=37.9% moe_balance_loss=0.0219 expert_gini=0.0236 | |
| [2026-10-08T14:21:07Z step 1830257] loss=1.0562 lr=7.17314e-05 lr_phase=decay grad_norm=1.313 tokens/s=13.36M mfu=39.0% moe_balance_loss=0.0214 expert_gini=0.0227 | |
| [2026-10-08T14:21:13Z step 1830258] loss=1.0638 lr=7.17307e-05 lr_phase=decay grad_norm=1.542 tokens/s=13.04M mfu=38.1% moe_balance_loss=0.0216 expert_gini=0.0230 | |
| [2026-10-08T14:21:20Z step 1830259] loss=1.0555 lr=7.17300e-05 lr_phase=decay grad_norm=1.335 tokens/s=12.92M mfu=37.7% moe_balance_loss=0.0215 expert_gini=0.0234 | |
| [2026-10-08T14:21:26Z step 1830260] loss=1.0474 lr=7.17294e-05 lr_phase=decay grad_norm=1.202 tokens/s=12.63M mfu=36.9% moe_balance_loss=0.0215 expert_gini=0.0229 | |
| [2026-10-08T14:21:33Z step 1830261] loss=1.0580 lr=7.17287e-05 lr_phase=decay grad_norm=1.373 tokens/s=12.90M mfu=37.7% moe_balance_loss=0.0216 expert_gini=0.0232 | |
| [2026-10-08T14:21:40Z step 1830262] loss=1.0579 lr=7.17280e-05 lr_phase=decay grad_norm=1.383 tokens/s=12.64M mfu=36.9% moe_balance_loss=0.0215 expert_gini=0.0230 | |
| [2026-10-08T14:21:46Z step 1830263] loss=1.0537 lr=7.17274e-05 lr_phase=decay grad_norm=1.505 tokens/s=13.20M mfu=38.5% moe_balance_loss=0.0217 expert_gini=0.0235 | |
| [2026-10-08T14:21:52Z step 1830264] loss=1.0550 lr=7.17267e-05 lr_phase=decay grad_norm=1.460 tokens/s=13.25M mfu=38.7% moe_balance_loss=0.0214 expert_gini=0.0229 | |
| [2026-10-08T14:21:59Z step 1830265] loss=1.0577 lr=7.17260e-05 lr_phase=decay grad_norm=1.739 tokens/s=12.31M mfu=35.9% moe_balance_loss=0.0218 expert_gini=0.0235 | |
| [2026-10-08T14:22:06Z step 1830266] loss=1.0544 lr=7.17254e-05 lr_phase=decay grad_norm=1.439 tokens/s=12.37M mfu=36.1% moe_balance_loss=0.0215 expert_gini=0.0226 | |
| [2026-10-08T14:22:13Z step 1830267] loss=1.0588 lr=7.17247e-05 lr_phase=decay grad_norm=1.506 tokens/s=12.05M mfu=35.2% moe_balance_loss=0.0216 expert_gini=0.0229 | |
| [2026-10-08T14:22:19Z step 1830268] loss=1.0596 lr=7.17241e-05 lr_phase=decay grad_norm=1.218 tokens/s=12.75M mfu=37.2% moe_balance_loss=0.0216 expert_gini=0.0232 | |
| [2026-10-08T14:22:26Z step 1830269] loss=1.0493 lr=7.17234e-05 lr_phase=decay grad_norm=1.548 tokens/s=12.37M mfu=36.1% moe_balance_loss=0.0214 expert_gini=0.0230 | |
| [2026-10-08T14:22:33Z step 1830270] loss=1.0502 lr=7.17227e-05 lr_phase=decay grad_norm=1.007 tokens/s=12.19M mfu=35.6% moe_balance_loss=0.0215 expert_gini=0.0228 | |
| [2026-10-08T14:22:40Z step 1830271] loss=1.0551 lr=7.17221e-05 lr_phase=decay grad_norm=1.534 tokens/s=12.17M mfu=35.5% moe_balance_loss=0.0219 expert_gini=0.0234 | |
| [2026-10-08T14:22:47Z step 1830272] loss=1.0492 lr=7.17214e-05 lr_phase=decay grad_norm=1.281 tokens/s=12.03M mfu=35.1% moe_balance_loss=0.0213 expert_gini=0.0224 | |
| [2026-10-08T14:22:54Z step 1830273] loss=1.0509 lr=7.17207e-05 lr_phase=decay grad_norm=1.465 tokens/s=11.49M mfu=33.5% moe_balance_loss=0.0215 expert_gini=0.0227 | |
| [2026-10-08T14:23:02Z step 1830274] loss=1.0455 lr=7.17201e-05 lr_phase=decay grad_norm=1.400 tokens/s=11.52M mfu=33.6% moe_balance_loss=0.0215 expert_gini=0.0231 | |
| [2026-10-08T14:23:09Z step 1830275] loss=1.0538 lr=7.17194e-05 lr_phase=decay grad_norm=1.567 tokens/s=12.28M mfu=35.8% moe_balance_loss=0.0217 expert_gini=0.0231 | |
| [2026-10-08T14:23:16Z step 1830276] loss=1.0494 lr=7.17187e-05 lr_phase=decay grad_norm=1.475 tokens/s=12.54M mfu=36.6% moe_balance_loss=0.0216 expert_gini=0.0231 | |
| [2026-10-08T14:23:23Z step 1830277] loss=1.0520 lr=7.17181e-05 lr_phase=decay grad_norm=1.427 tokens/s=12.42M mfu=36.3% moe_balance_loss=0.0216 expert_gini=0.0232 | |
| [2026-10-08T14:23:29Z step 1830278] loss=1.0463 lr=7.17174e-05 lr_phase=decay grad_norm=1.108 tokens/s=12.48M mfu=36.4% moe_balance_loss=0.0217 expert_gini=0.0232 | |
| [2026-10-08T14:23:37Z step 1830279] loss=1.0514 lr=7.17168e-05 lr_phase=decay grad_norm=1.411 tokens/s=11.54M mfu=33.7% moe_balance_loss=0.0213 expert_gini=0.0228 | |
| [2026-10-08T14:23:43Z step 1830280] loss=1.0516 lr=7.17161e-05 lr_phase=decay grad_norm=0.973 tokens/s=12.39M mfu=36.2% moe_balance_loss=0.0219 expert_gini=0.0236 | |
| [2026-10-08T14:23:50Z step 1830281] loss=1.0517 lr=7.17154e-05 lr_phase=decay grad_norm=1.250 tokens/s=12.94M mfu=37.8% moe_balance_loss=0.0220 expert_gini=0.0240 | |
| [2026-10-08T14:23:56Z step 1830282] loss=1.0547 lr=7.17148e-05 lr_phase=decay grad_norm=1.354 tokens/s=12.98M mfu=37.9% moe_balance_loss=0.0218 expert_gini=0.0237 | |
| [2026-10-08T14:24:03Z step 1830283] loss=1.0457 lr=7.17141e-05 lr_phase=decay grad_norm=1.287 tokens/s=12.45M mfu=36.3% moe_balance_loss=0.0215 expert_gini=0.0228 | |
| [2026-10-08T14:24:09Z step 1830284] loss=1.0439 lr=7.17134e-05 lr_phase=decay grad_norm=1.421 tokens/s=12.62M mfu=36.8% moe_balance_loss=0.0220 expert_gini=0.0236 | |
| [2026-10-08T14:24:16Z step 1830285] loss=1.0447 lr=7.17128e-05 lr_phase=decay grad_norm=1.097 tokens/s=13.13M mfu=38.3% moe_balance_loss=0.0214 expert_gini=0.0227 | |
| [2026-10-08T14:24:22Z step 1830286] loss=1.0533 lr=7.17121e-05 lr_phase=decay grad_norm=1.202 tokens/s=12.96M mfu=37.8% moe_balance_loss=0.0219 expert_gini=0.0235 | |
| [2026-10-08T14:24:29Z step 1830287] loss=1.0514 lr=7.17114e-05 lr_phase=decay grad_norm=1.657 tokens/s=12.45M mfu=36.3% moe_balance_loss=0.0219 expert_gini=0.0235 | |
| [2026-10-08T14:24:36Z step 1830288] loss=1.0501 lr=7.17108e-05 lr_phase=decay grad_norm=1.418 tokens/s=12.09M mfu=35.3% moe_balance_loss=0.0215 expert_gini=0.0228 | |
| [2026-10-08T14:24:42Z step 1830289] loss=1.0510 lr=7.17101e-05 lr_phase=decay grad_norm=1.282 tokens/s=12.32M mfu=36.0% moe_balance_loss=0.0218 expert_gini=0.0237 | |
| [2026-10-08T14:24:49Z step 1830290] loss=1.0468 lr=7.17095e-05 lr_phase=decay grad_norm=1.062 tokens/s=12.29M mfu=35.9% moe_balance_loss=0.0219 expert_gini=0.0235 | |
| [2026-10-08T14:24:56Z step 1830291] loss=1.0492 lr=7.17088e-05 lr_phase=decay grad_norm=1.319 tokens/s=12.92M mfu=37.7% moe_balance_loss=0.0214 expert_gini=0.0227 | |
| [2026-10-08T14:25:02Z step 1830292] loss=1.0502 lr=7.17081e-05 lr_phase=decay grad_norm=1.337 tokens/s=12.75M mfu=37.2% moe_balance_loss=0.0215 expert_gini=0.0230 | |
| [2026-10-08T14:25:09Z step 1830293] loss=1.0435 lr=7.17075e-05 lr_phase=decay grad_norm=1.300 tokens/s=12.77M mfu=37.3% moe_balance_loss=0.0213 expert_gini=0.0228 | |
| [2026-10-08T14:25:09Z step 1830293] eval(step 1830250). loss=1.1900 mmlu=0.8754(n=281) arc_challenge=0.7083(n=24) hellaswag=0.8806(n=201) eval_took=251s | |
| [2026-10-08T14:25:16Z step 1830294] loss=1.0475 lr=7.17068e-05 lr_phase=decay grad_norm=1.210 tokens/s=12.03M mfu=35.1% moe_balance_loss=0.0216 expert_gini=0.0234 | |
| [2026-10-08T14:25:23Z step 1830295] loss=1.0553 lr=7.17061e-05 lr_phase=decay grad_norm=1.479 tokens/s=12.33M mfu=36.0% moe_balance_loss=0.0214 expert_gini=0.0226 | |
| [2026-10-08T14:25:29Z step 1830296] loss=1.0579 lr=7.17055e-05 lr_phase=decay grad_norm=1.583 tokens/s=12.39M mfu=36.2% moe_balance_loss=0.0217 expert_gini=0.0229 | |
| [2026-10-08T14:25:36Z step 1830297] loss=1.0576 lr=7.17048e-05 lr_phase=decay grad_norm=1.588 tokens/s=12.47M mfu=36.4% moe_balance_loss=0.0218 expert_gini=0.0234 | |
| [2026-10-08T14:25:42Z step 1830298] loss=1.0576 lr=7.17041e-05 lr_phase=decay grad_norm=1.552 tokens/s=13.02M mfu=38.0% moe_balance_loss=0.0216 expert_gini=0.0231 | |
| [2026-10-08T14:25:49Z step 1830299] loss=1.0547 lr=7.17035e-05 lr_phase=decay grad_norm=1.277 tokens/s=13.04M mfu=38.1% moe_balance_loss=0.0218 expert_gini=0.0237 | |
| [2026-10-08T14:25:55Z step 1830300] loss=1.0448 lr=7.17028e-05 lr_phase=decay grad_norm=1.551 tokens/s=13.15M mfu=38.4% moe_balance_loss=0.0215 expert_gini=0.0230 | |
| [2026-10-08T14:25:55Z step 1830300] async checkpoint in 165.8s | |
| [2026-10-08T14:26:02Z step 1830301] loss=1.0410 lr=7.17022e-05 lr_phase=decay grad_norm=0.917 tokens/s=13.18M mfu=38.5% moe_balance_loss=0.0214 expert_gini=0.0228 | |
| [2026-10-08T14:26:08Z step 1830302] loss=1.0440 lr=7.17015e-05 lr_phase=decay grad_norm=1.146 tokens/s=12.66M mfu=37.0% moe_balance_loss=0.0218 expert_gini=0.0236 | |
| [2026-10-08T14:26:15Z step 1830303] loss=1.0430 lr=7.17008e-05 lr_phase=decay grad_norm=1.262 tokens/s=12.40M mfu=36.2% moe_balance_loss=0.0218 expert_gini=0.0235 | |
| [2026-10-08T14:26:22Z step 1830304] loss=1.0429 lr=7.17002e-05 lr_phase=decay grad_norm=0.983 tokens/s=12.73M mfu=37.2% moe_balance_loss=0.0215 expert_gini=0.0231 | |
| [2026-10-08T14:26:28Z step 1830305] loss=1.0468 lr=7.16995e-05 lr_phase=decay grad_norm=1.491 tokens/s=12.83M mfu=37.5% moe_balance_loss=0.0214 expert_gini=0.0229 | |
| [2026-10-08T14:26:35Z step 1830306] loss=1.0491 lr=7.16988e-05 lr_phase=decay grad_norm=1.021 tokens/s=13.49M mfu=39.4% moe_balance_loss=0.0216 expert_gini=0.0233 | |
| [2026-10-08T14:26:41Z step 1830307] loss=1.0501 lr=7.16982e-05 lr_phase=decay grad_norm=1.545 tokens/s=13.51M mfu=39.4% moe_balance_loss=0.0218 expert_gini=0.0231 | |
| [2026-10-08T14:26:47Z step 1830308] loss=1.0493 lr=7.16975e-05 lr_phase=decay grad_norm=1.326 tokens/s=13.06M mfu=38.1% moe_balance_loss=0.0217 expert_gini=0.0230 | |
| [2026-10-08T14:26:54Z step 1830309] loss=1.0443 lr=7.16969e-05 lr_phase=decay grad_norm=1.350 tokens/s=12.76M mfu=37.3% moe_balance_loss=0.0218 expert_gini=0.0234 | |
| [2026-10-08T14:27:01Z step 1830310] loss=1.0488 lr=7.16962e-05 lr_phase=decay grad_norm=1.394 tokens/s=12.64M mfu=36.9% moe_balance_loss=0.0215 expert_gini=0.0231 | |
| [2026-10-08T14:27:07Z step 1830311] loss=1.0452 lr=7.16955e-05 lr_phase=decay grad_norm=0.935 tokens/s=13.02M mfu=38.0% moe_balance_loss=0.0216 expert_gini=0.0231 | |
| [2026-10-08T14:27:14Z step 1830312] loss=1.0403 lr=7.16949e-05 lr_phase=decay grad_norm=1.331 tokens/s=12.69M mfu=37.1% moe_balance_loss=0.0215 expert_gini=0.0229 | |
| [2026-10-08T14:27:20Z step 1830313] loss=1.0459 lr=7.16942e-05 lr_phase=decay grad_norm=1.223 tokens/s=12.75M mfu=37.2% moe_balance_loss=0.0217 expert_gini=0.0232 | |
| [2026-10-08T14:27:26Z step 1830314] loss=1.0451 lr=7.16935e-05 lr_phase=decay grad_norm=1.360 tokens/s=12.84M mfu=37.5% moe_balance_loss=0.0216 expert_gini=0.0227 | |
| [2026-10-08T14:27:33Z step 1830315] loss=1.0493 lr=7.16929e-05 lr_phase=decay grad_norm=1.284 tokens/s=13.00M mfu=37.9% moe_balance_loss=0.0217 expert_gini=0.0228 | |
| [2026-10-08T14:27:39Z step 1830316] loss=1.0476 lr=7.16922e-05 lr_phase=decay grad_norm=1.320 tokens/s=13.72M mfu=40.1% moe_balance_loss=0.0215 expert_gini=0.0228 | |
| [2026-10-08T14:27:45Z step 1830317] loss=1.0418 lr=7.16915e-05 lr_phase=decay grad_norm=1.507 tokens/s=13.39M mfu=39.1% moe_balance_loss=0.0217 expert_gini=0.0230 | |
| [2026-10-08T14:27:51Z step 1830318] loss=1.0484 lr=7.16909e-05 lr_phase=decay grad_norm=1.047 tokens/s=12.96M mfu=37.8% moe_balance_loss=0.0214 expert_gini=0.0230 | |
| [2026-10-08T14:27:58Z step 1830319] loss=1.0436 lr=7.16902e-05 lr_phase=decay grad_norm=1.850 tokens/s=12.87M mfu=37.6% moe_balance_loss=0.0219 expert_gini=0.0233 | |
| [2026-10-08T14:28:05Z step 1830320] loss=1.0484 lr=7.16896e-05 lr_phase=decay grad_norm=1.120 tokens/s=12.79M mfu=37.3% moe_balance_loss=0.0216 expert_gini=0.0230 | |
| [2026-10-08T14:28:11Z step 1830321] loss=1.0501 lr=7.16889e-05 lr_phase=decay grad_norm=1.420 tokens/s=12.74M mfu=37.2% moe_balance_loss=0.0216 expert_gini=0.0234 | |
| [2026-10-08T14:28:17Z step 1830322] loss=1.0474 lr=7.16882e-05 lr_phase=decay grad_norm=1.325 tokens/s=13.05M mfu=38.1% moe_balance_loss=0.0216 expert_gini=0.0236 | |
| [2026-10-08T14:28:24Z step 1830323] loss=1.0406 lr=7.16876e-05 lr_phase=decay grad_norm=1.207 tokens/s=12.70M mfu=37.1% moe_balance_loss=0.0213 expert_gini=0.0225 | |
| [2026-10-08T14:28:30Z step 1830324] loss=1.0475 lr=7.16869e-05 lr_phase=decay grad_norm=1.111 tokens/s=13.20M mfu=38.5% moe_balance_loss=0.0215 expert_gini=0.0231 | |
| [2026-10-08T14:28:37Z step 1830325] loss=1.0491 lr=7.16862e-05 lr_phase=decay grad_norm=1.266 tokens/s=12.99M mfu=37.9% moe_balance_loss=0.0214 expert_gini=0.0227 | |
| [2026-10-08T14:28:44Z step 1830326] loss=1.0430 lr=7.16856e-05 lr_phase=decay grad_norm=1.418 tokens/s=12.44M mfu=36.3% moe_balance_loss=0.0212 expert_gini=0.0223 | |
| [2026-10-08T14:28:51Z step 1830327] loss=1.0372 lr=7.16849e-05 lr_phase=decay grad_norm=1.202 tokens/s=11.51M mfu=33.6% moe_balance_loss=0.0217 expert_gini=0.0237 | |
| [2026-10-08T14:28:58Z step 1830328] loss=1.0446 lr=7.16842e-05 lr_phase=decay grad_norm=1.381 tokens/s=11.55M mfu=33.7% moe_balance_loss=0.0216 expert_gini=0.0230 | |
| [2026-10-08T14:29:05Z step 1830329] loss=1.0561 lr=7.16836e-05 lr_phase=decay grad_norm=1.364 tokens/s=11.67M mfu=34.1% moe_balance_loss=0.0218 expert_gini=0.0232 | |
| [2026-10-08T14:29:13Z step 1830330] loss=1.0597 lr=7.16829e-05 lr_phase=decay grad_norm=1.713 tokens/s=11.40M mfu=33.3% moe_balance_loss=0.0216 expert_gini=0.0233 | |
| [2026-10-08T14:29:20Z step 1830331] loss=1.0523 lr=7.16823e-05 lr_phase=decay grad_norm=1.378 tokens/s=11.68M mfu=34.1% moe_balance_loss=0.0212 expert_gini=0.0220 | |
| [2026-10-08T14:29:27Z step 1830332] loss=1.0546 lr=7.16816e-05 lr_phase=decay grad_norm=1.795 tokens/s=12.07M mfu=35.2% moe_balance_loss=0.0218 expert_gini=0.0236 | |
| [2026-10-08T14:29:34Z step 1830333] loss=1.0549 lr=7.16809e-05 lr_phase=decay grad_norm=1.575 tokens/s=12.46M mfu=36.4% moe_balance_loss=0.0214 expert_gini=0.0227 | |
| [2026-10-08T14:29:41Z step 1830334] loss=1.0514 lr=7.16803e-05 lr_phase=decay grad_norm=1.541 tokens/s=11.88M mfu=34.7% moe_balance_loss=0.0216 expert_gini=0.0231 | |
| [2026-10-08T14:29:48Z step 1830335] loss=1.0521 lr=7.16796e-05 lr_phase=decay grad_norm=1.400 tokens/s=12.46M mfu=36.4% moe_balance_loss=0.0217 expert_gini=0.0234 | |
| [2026-10-08T14:29:55Z step 1830336] loss=1.0567 lr=7.16789e-05 lr_phase=decay grad_norm=1.489 tokens/s=12.27M mfu=35.8% moe_balance_loss=0.0217 expert_gini=0.0232 | |
| [2026-10-08T14:30:02Z step 1830337] loss=1.0527 lr=7.16783e-05 lr_phase=decay grad_norm=1.362 tokens/s=12.22M mfu=35.7% moe_balance_loss=0.0213 expert_gini=0.0227 | |
| [2026-10-08T14:30:08Z step 1830338] loss=1.0509 lr=7.16776e-05 lr_phase=decay grad_norm=1.451 tokens/s=12.14M mfu=35.4% moe_balance_loss=0.0216 expert_gini=0.0232 | |
| [2026-10-08T14:30:15Z step 1830339] loss=1.0565 lr=7.16769e-05 lr_phase=decay grad_norm=1.402 tokens/s=12.36M mfu=36.1% moe_balance_loss=0.0216 expert_gini=0.0229 | |
| [2026-10-08T14:30:22Z step 1830340] loss=1.0525 lr=7.16763e-05 lr_phase=decay grad_norm=1.383 tokens/s=12.27M mfu=35.8% moe_balance_loss=0.0214 expert_gini=0.0227 | |
| [2026-10-08T14:30:28Z step 1830341] loss=1.0581 lr=7.16756e-05 lr_phase=decay grad_norm=1.329 tokens/s=11.98M mfu=35.0% moe_balance_loss=0.0218 expert_gini=0.0233 | |
| [2026-10-08T14:30:35Z step 1830342] loss=1.0534 lr=7.16750e-05 lr_phase=decay grad_norm=1.553 tokens/s=11.95M mfu=34.9% moe_balance_loss=0.0215 expert_gini=0.0231 | |
| [2026-10-08T14:30:35Z step 1830342] eval(step 1830300). loss=1.1887 mmlu=0.8861(n=281) arc_challenge=0.7083(n=24) hellaswag=0.8657(n=201) eval_took=246s | |
| [2026-10-08T14:30:42Z step 1830343] loss=1.0516 lr=7.16743e-05 lr_phase=decay grad_norm=1.337 tokens/s=12.69M mfu=37.0% moe_balance_loss=0.0213 expert_gini=0.0228 | |
| [2026-10-08T14:30:49Z step 1830344] loss=1.0549 lr=7.16736e-05 lr_phase=decay grad_norm=1.393 tokens/s=11.99M mfu=35.0% moe_balance_loss=0.0218 expert_gini=0.0234 | |
| [2026-10-08T14:30:56Z step 1830345] loss=1.0559 lr=7.16730e-05 lr_phase=decay grad_norm=1.521 tokens/s=12.06M mfu=35.2% moe_balance_loss=0.0214 expert_gini=0.0229 | |
| [2026-10-08T14:31:03Z step 1830346] loss=1.0498 lr=7.16723e-05 lr_phase=decay grad_norm=1.599 tokens/s=12.49M mfu=36.5% moe_balance_loss=0.0214 expert_gini=0.0230 | |
| [2026-10-08T14:31:10Z step 1830347] loss=1.0488 lr=7.16716e-05 lr_phase=decay grad_norm=1.442 tokens/s=12.25M mfu=35.8% moe_balance_loss=0.0217 expert_gini=0.0235 | |
| [2026-10-08T14:31:17Z step 1830348] loss=1.0490 lr=7.16710e-05 lr_phase=decay grad_norm=1.134 tokens/s=11.73M mfu=34.3% moe_balance_loss=0.0217 expert_gini=0.0230 | |
| [2026-10-08T14:31:25Z step 1830349] loss=1.0516 lr=7.16703e-05 lr_phase=decay grad_norm=1.197 tokens/s=11.34M mfu=33.1% moe_balance_loss=0.0216 expert_gini=0.0227 | |
| [2026-10-08T14:31:32Z step 1830350] loss=1.0488 lr=7.16697e-05 lr_phase=decay grad_norm=1.605 tokens/s=11.41M mfu=33.3% moe_balance_loss=0.0219 expert_gini=0.0233 | |
| [2026-10-08T14:31:32Z step 1830350] async checkpoint in 165.6s | |
| [2026-10-08T14:31:39Z step 1830351] loss=1.0576 lr=7.16690e-05 lr_phase=decay grad_norm=1.359 tokens/s=11.50M mfu=33.6% moe_balance_loss=0.0216 expert_gini=0.0230 | |
| [2026-10-08T14:31:46Z step 1830352] loss=1.0570 lr=7.16683e-05 lr_phase=decay grad_norm=1.575 tokens/s=11.66M mfu=34.0% moe_balance_loss=0.0217 expert_gini=0.0231 | |
| [2026-10-08T14:31:54Z step 1830353] loss=1.0539 lr=7.16677e-05 lr_phase=decay grad_norm=1.299 tokens/s=11.46M mfu=33.5% moe_balance_loss=0.0214 expert_gini=0.0228 | |
| [2026-10-08T14:32:00Z step 1830354] loss=1.0538 lr=7.16670e-05 lr_phase=decay grad_norm=1.376 tokens/s=12.35M mfu=36.0% moe_balance_loss=0.0217 expert_gini=0.0230 | |
| [2026-10-08T14:32:06Z step 1830355] loss=1.0582 lr=7.16663e-05 lr_phase=decay grad_norm=1.499 tokens/s=12.76M mfu=37.2% moe_balance_loss=0.0214 expert_gini=0.0226 | |
| [2026-10-08T14:32:13Z step 1830356] loss=1.0532 lr=7.16657e-05 lr_phase=decay grad_norm=1.211 tokens/s=12.51M mfu=36.5% moe_balance_loss=0.0215 expert_gini=0.0234 | |
| [2026-10-08T14:32:20Z step 1830357] loss=1.0547 lr=7.16650e-05 lr_phase=decay grad_norm=1.477 tokens/s=12.94M mfu=37.8% moe_balance_loss=0.0215 expert_gini=0.0226 | |
| [2026-10-08T14:32:27Z step 1830358] loss=1.0502 lr=7.16643e-05 lr_phase=decay grad_norm=1.500 tokens/s=12.44M mfu=36.3% moe_balance_loss=0.0216 expert_gini=0.0230 | |
| [2026-10-08T14:32:34Z step 1830359] loss=1.0512 lr=7.16637e-05 lr_phase=decay grad_norm=1.134 tokens/s=12.21M mfu=35.6% moe_balance_loss=0.0213 expert_gini=0.0225 | |
| [2026-10-08T14:32:41Z step 1830360] loss=1.0606 lr=7.16630e-05 lr_phase=decay grad_norm=1.513 tokens/s=12.14M mfu=35.4% moe_balance_loss=0.0215 expert_gini=0.0230 | |
| [2026-10-08T14:32:48Z step 1830361] loss=1.0542 lr=7.16624e-05 lr_phase=decay grad_norm=1.642 tokens/s=11.84M mfu=34.6% moe_balance_loss=0.0213 expert_gini=0.0227 | |
| [2026-10-08T14:32:54Z step 1830362] loss=1.0518 lr=7.16617e-05 lr_phase=decay grad_norm=1.456 tokens/s=12.30M mfu=35.9% moe_balance_loss=0.0214 expert_gini=0.0228 | |
| [2026-10-08T14:33:01Z step 1830363] loss=1.0558 lr=7.16610e-05 lr_phase=decay grad_norm=1.612 tokens/s=12.48M mfu=36.4% moe_balance_loss=0.0215 expert_gini=0.0230 | |
| [2026-10-08T14:33:08Z step 1830364] loss=1.0522 lr=7.16604e-05 lr_phase=decay grad_norm=1.356 tokens/s=12.49M mfu=36.5% moe_balance_loss=0.0215 expert_gini=0.0228 | |
| [2026-10-08T14:33:14Z step 1830365] loss=1.0510 lr=7.16597e-05 lr_phase=decay grad_norm=0.946 tokens/s=12.70M mfu=37.1% moe_balance_loss=0.0214 expert_gini=0.0225 | |
| [2026-10-08T14:33:21Z step 1830366] loss=1.0389 lr=7.16590e-05 lr_phase=decay grad_norm=1.288 tokens/s=13.23M mfu=38.6% moe_balance_loss=0.0217 expert_gini=0.0234 | |
| [2026-10-08T14:33:27Z step 1830367] loss=1.0403 lr=7.16584e-05 lr_phase=decay grad_norm=1.040 tokens/s=12.80M mfu=37.4% moe_balance_loss=0.0216 expert_gini=0.0233 | |
| [2026-10-08T14:33:34Z step 1830368] loss=1.0413 lr=7.16577e-05 lr_phase=decay grad_norm=1.354 tokens/s=12.96M mfu=37.8% moe_balance_loss=0.0215 expert_gini=0.0228 | |
| [2026-10-08T14:33:40Z step 1830369] loss=1.0456 lr=7.16570e-05 lr_phase=decay grad_norm=1.164 tokens/s=12.98M mfu=37.9% moe_balance_loss=0.0217 expert_gini=0.0235 | |
| [2026-10-08T14:33:47Z step 1830370] loss=1.0436 lr=7.16564e-05 lr_phase=decay grad_norm=1.186 tokens/s=12.40M mfu=36.2% moe_balance_loss=0.0217 expert_gini=0.0232 | |
| [2026-10-08T14:33:54Z step 1830371] loss=1.0431 lr=7.16557e-05 lr_phase=decay grad_norm=1.306 tokens/s=12.08M mfu=35.3% moe_balance_loss=0.0216 expert_gini=0.0235 | |
| [2026-10-08T14:34:01Z step 1830372] loss=1.0410 lr=7.16551e-05 lr_phase=decay grad_norm=1.248 tokens/s=11.87M mfu=34.7% moe_balance_loss=0.0215 expert_gini=0.0225 | |
| [2026-10-08T14:34:09Z step 1830373] loss=1.0471 lr=7.16544e-05 lr_phase=decay grad_norm=1.059 tokens/s=11.35M mfu=33.1% moe_balance_loss=0.0217 expert_gini=0.0232 | |
| [2026-10-08T14:34:16Z step 1830374] loss=1.0462 lr=7.16537e-05 lr_phase=decay grad_norm=1.242 tokens/s=11.75M mfu=34.3% moe_balance_loss=0.0219 expert_gini=0.0235 | |
| [2026-10-08T14:34:23Z step 1830375] loss=1.0477 lr=7.16531e-05 lr_phase=decay grad_norm=1.155 tokens/s=12.16M mfu=35.5% moe_balance_loss=0.0215 expert_gini=0.0227 | |
| [2026-10-08T14:34:29Z step 1830376] loss=1.0430 lr=7.16524e-05 lr_phase=decay grad_norm=1.013 tokens/s=12.50M mfu=36.5% moe_balance_loss=0.0215 expert_gini=0.0231 | |
| [2026-10-08T14:34:36Z step 1830377] loss=1.0410 lr=7.16517e-05 lr_phase=decay grad_norm=1.273 tokens/s=12.35M mfu=36.1% moe_balance_loss=0.0217 expert_gini=0.0231 | |
| [2026-10-08T14:34:43Z step 1830378] loss=1.0486 lr=7.16511e-05 lr_phase=decay grad_norm=1.017 tokens/s=12.47M mfu=36.4% moe_balance_loss=0.0214 expert_gini=0.0229 | |
| [2026-10-08T14:34:49Z step 1830379] loss=1.0402 lr=7.16504e-05 lr_phase=decay grad_norm=1.468 tokens/s=12.30M mfu=35.9% moe_balance_loss=0.0221 expert_gini=0.0238 | |
| [2026-10-08T14:34:56Z step 1830380] loss=1.0463 lr=7.16497e-05 lr_phase=decay grad_norm=1.117 tokens/s=12.60M mfu=36.8% moe_balance_loss=0.0217 expert_gini=0.0232 | |
| [2026-10-08T14:35:04Z step 1830381] loss=1.0437 lr=7.16491e-05 lr_phase=decay grad_norm=1.226 tokens/s=11.97M mfu=34.9% moe_balance_loss=0.0217 expert_gini=0.0230 | |
| [2026-10-08T14:35:11Z step 1830382] loss=1.0402 lr=7.16484e-05 lr_phase=decay grad_norm=1.443 tokens/s=11.78M mfu=34.4% moe_balance_loss=0.0218 expert_gini=0.0237 | |
| [2026-10-08T14:35:18Z step 1830383] loss=1.0464 lr=7.16478e-05 lr_phase=decay grad_norm=1.457 tokens/s=11.91M mfu=34.8% moe_balance_loss=0.0215 expert_gini=0.0228 | |
| [2026-10-08T14:35:25Z step 1830384] loss=1.0550 lr=7.16471e-05 lr_phase=decay grad_norm=1.505 tokens/s=12.19M mfu=35.6% moe_balance_loss=0.0216 expert_gini=0.0231 | |
| [2026-10-08T14:35:32Z step 1830385] loss=1.0496 lr=7.16464e-05 lr_phase=decay grad_norm=1.310 tokens/s=12.39M mfu=36.2% moe_balance_loss=0.0216 expert_gini=0.0229 | |
| [2026-10-08T14:35:38Z step 1830386] loss=1.0507 lr=7.16458e-05 lr_phase=decay grad_norm=1.481 tokens/s=12.74M mfu=37.2% moe_balance_loss=0.0214 expert_gini=0.0227 | |
| [2026-10-08T14:35:45Z step 1830387] loss=1.0507 lr=7.16451e-05 lr_phase=decay grad_norm=1.248 tokens/s=12.25M mfu=35.8% moe_balance_loss=0.0218 expert_gini=0.0234 | |
| [2026-10-08T14:35:52Z step 1830388] loss=1.0517 lr=7.16444e-05 lr_phase=decay grad_norm=1.430 tokens/s=12.54M mfu=36.6% moe_balance_loss=0.0215 expert_gini=0.0231 | |
| [2026-10-08T14:35:59Z step 1830389] loss=1.0576 lr=7.16438e-05 lr_phase=decay grad_norm=1.682 tokens/s=12.24M mfu=35.7% moe_balance_loss=0.0216 expert_gini=0.0233 | |
| [2026-10-08T14:36:06Z step 1830390] loss=1.0572 lr=7.16431e-05 lr_phase=decay grad_norm=1.560 tokens/s=11.87M mfu=34.6% moe_balance_loss=0.0213 expert_gini=0.0224 | |
| [2026-10-08T14:36:13Z step 1830391] loss=1.0468 lr=7.16424e-05 lr_phase=decay grad_norm=1.342 tokens/s=11.67M mfu=34.1% moe_balance_loss=0.0213 expert_gini=0.0228 | |
| [2026-10-08T14:36:21Z step 1830392] loss=1.0544 lr=7.16418e-05 lr_phase=decay grad_norm=1.552 tokens/s=10.91M mfu=31.9% moe_balance_loss=0.0216 expert_gini=0.0229 | |
| [2026-10-08T14:36:29Z step 1830393] loss=1.0525 lr=7.16411e-05 lr_phase=decay grad_norm=1.365 tokens/s=10.96M mfu=32.0% moe_balance_loss=0.0216 expert_gini=0.0233 | |
| [2026-10-08T14:36:37Z step 1830394] loss=1.0539 lr=7.16405e-05 lr_phase=decay grad_norm=1.400 tokens/s=10.79M mfu=31.5% moe_balance_loss=0.0216 expert_gini=0.0231 | |
| [2026-10-08T14:36:37Z step 1830394] eval(step 1830350). loss=1.1894 mmlu=0.8861(n=281) arc_challenge=0.7083(n=24) hellaswag=0.8756(n=201) eval_took=267s | |
| [2026-10-08T14:36:44Z step 1830395] loss=1.0516 lr=7.16398e-05 lr_phase=decay grad_norm=1.474 tokens/s=11.17M mfu=32.6% moe_balance_loss=0.0213 expert_gini=0.0229 | |
| [2026-10-08T14:36:52Z step 1830396] loss=1.0486 lr=7.16391e-05 lr_phase=decay grad_norm=1.452 tokens/s=11.07M mfu=32.3% moe_balance_loss=0.0218 expert_gini=0.0233 | |
| [2026-10-08T14:36:59Z step 1830397] loss=1.0535 lr=7.16385e-05 lr_phase=decay grad_norm=1.349 tokens/s=11.03M mfu=32.2% moe_balance_loss=0.0220 expert_gini=0.0235 | |
| [2026-10-08T14:37:06Z step 1830398] loss=1.0451 lr=7.16378e-05 lr_phase=decay grad_norm=1.338 tokens/s=11.57M mfu=33.8% moe_balance_loss=0.0216 expert_gini=0.0230 | |
| [2026-10-08T14:37:14Z step 1830399] loss=1.0454 lr=7.16371e-05 lr_phase=decay grad_norm=1.151 tokens/s=11.04M mfu=32.2% moe_balance_loss=0.0217 expert_gini=0.0235 | |
| [2026-10-08T14:37:21Z step 1830400] loss=1.0421 lr=7.16365e-05 lr_phase=decay grad_norm=1.266 tokens/s=11.25M mfu=32.9% moe_balance_loss=0.0218 expert_gini=0.0235 | |
| [2026-10-08T14:37:21Z step 1830400] async checkpoint in 178.1s | |
Xet Storage Details
- Size:
- 66.8 kB
- Xet hash:
- 93dbef27544c2a9459eaaca97245a62436887eb48901d98f293ed79964b12b58
·
Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.