File size: 277 Bytes
77d6503 | 1 2 3 4 5 6 7 8 9 10 | tokens 1732003925 shards 12 batches 16819 window 65536 grad_accum 8 usable_steps 2102 mix b5_65536_131072 target 0.5000 actual 0.4999 tokens 865840569 mix b3_16384_32768 target 0.3000 actual 0.3001 tokens 519688950 mix b1_4096_8192 target 0.2000 actual 0.2000 tokens 346474406 |