| tokens 900068420 | |
| shards 10 | |
| batches 13728 | |
| window 65536 | |
| grad_accum 8 | |
| usable_steps 1716 | |
| mix b5_65536_131072 target 0.5000 actual 0.5001 tokens 450083582 | |
| mix b3_16384_32768 target 0.3000 actual 0.3000 tokens 269995569 | |
| mix b1_4096_8192 target 0.2000 actual 0.2000 tokens 179989269 | |