Upload logs/2026-09-22_t128c_master.log with huggingface_hub
Browse files
logs/2026-09-22_t128c_master.log
ADDED
|
@@ -0,0 +1,8 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
[06:32:27] === 128k run #3 (t128c) -- 8x H100, batch fix only ===
|
| 2 |
+
[06:32:27] parent : checkpoints_bluscriptcp/rank_0/t64.ckpt
|
| 3 |
+
[06:32:27] data : data/mix128_b6_35_640M (UNCHANGED from run #2) usable 609 steps at GB=1048576
|
| 4 |
+
[06:32:27] batch : 1048576 = 8 seqs/step <-- the only change (run #2 was 4)
|
| 5 |
+
[06:32:27] LR : 1.8e-4 flat, decay_start=597 of 600 -> pre-anneal stop
|
| 6 |
+
[06:32:27] ckpts : every 50 steps, KEEP=4 (disk 144G free)
|
| 7 |
+
[06:32:27] GATE : eval at every ckpt. If niah_single @4096 < 98, STOP and diagnose.
|
| 8 |
+
[08:49:36] done, run 4, loss: 1.708563
|