Upload logs/128k_master.log with huggingface_hub

logs/128k_master.log

@@ -1,20 +1,40 @@
-[05:38:41] FATAL: ./build/bluscriptCP_exec not built
-[09:16:06] === 680M 131k extension, 8x H200, cp=8 dp=1 ===
-[09:16:06] parent : t64 (98 @65,512 -- the 64k model, staged ladder)
-[09:16:06] YaRN   : SCALE=32 x ORIG=4096 = 131072 == CP_T  INVARIANT HOLDS
-[09:16:06]          virtual range 0..4095 (full), 32 tokens/virtual unit
-[09:16:06] LR     : peak 1.8e-4 (6e-4 x 0.3), warmup 100 / stable 900 / DECAY 200 -> 6e-5
-[09:16:06] data   : Data_Loader/Data/mix128  b6=8.9 b5=39 b4=25 b3=15 b1=10, usable 1219 steps, running 1200
-[09:16:06] PROBE cp=8 (16384 tok/rank, grad_accum 4)
-[09:16:58] PROBE FAILED rc=1 steps=0
-[09:17:28] === 680M 131k extension, 8x H200, cp=8 dp=1 ===
-[09:17:28] parent : t64 (98 @65,512 -- the 64k model, staged ladder)
-[09:17:28] YaRN   : SCALE=32 x ORIG=4096 = 131072 == CP_T  INVARIANT HOLDS
-[09:17:28]          virtual range 0..4095 (full), 32 tokens/virtual unit
-[09:17:28] LR     : peak 1.8e-4 (6e-4 x 0.3), warmup 100 / stable 900 / DECAY 200 -> 6e-5
-[09:17:28] data   : Data_Loader/Data/mix128  b6=8.9 b5=39 b4=25 b3=15 b1=10, usable 1219 steps, running 1200
-[09:17:28] PROBE cp=8 (16384 tok/rank, grad_accum 4)
-[09:19:08] PROBE OK cp=8: peak mem: 86705MB of 143771 MiB (H200), dt dt: 20144.88ms
-[09:19:08] TRAINING 1200 steps
-[11:17:55] done, run 3, loss: 1.024427
-[11:17:55] === 131K TRAINING COMPLETE ===
+[11:17:55] === RULER: 1 task(s) x 3 models x 6 lengths, N=100 ===
+[11:17:55] models: t128 t64 base680
+[11:17:55] jobs per length: 3  across 8 GPUs
+[11:17:55] len 4096  (T=262144 x64 -> virtual 64)
+[11:20:28]   done: 1/1 tasks scored
+    niah_single,87.0,98.0,100.0
+[11:20:28] len 8192  (T=262144 x64 -> virtual 128)
+[11:29:05]   done: 1/1 tasks scored
+    niah_single,82.0,92.0,99.0
+[11:29:05] len 16384  (T=262144 x64 -> virtual 256)
+[11:41:27]   done: 1/1 tasks scored
+    niah_single,87.0,100.0,100.0
+[11:41:27] len 32744  (T=262144 x64 -> virtual 511)
+[11:55:01]   done: 1/1 tasks scored
+    niah_single,79.0,69.0,99.0
+[11:55:01] len 65512  (T=262144 x64 -> virtual 1023)
+[12:15:16]   done: 1/1 tasks scored
+    niah_single,75.0,54.0,98.0
+[12:15:16] len 131000  (T=262144 x64 -> virtual 2046)
+[13:12:35]   done: 1/1 tasks scored
+    niah_single,36.0,33.0,62.0
+[13:12:35] === RULER COMPLETE ===
+[13:12:35] len 4096:
+    task,base680,t128,t64
+    niah_single,87.0,98.0,100.0
+[13:12:35] len 8192:
+    task,base680,t128,t64
+    niah_single,82.0,92.0,99.0
+[13:12:35] len 16384:
+    task,base680,t128,t64
+    niah_single,87.0,100.0,100.0
+[13:12:35] len 32744:
+    task,base680,t128,t64
+    niah_single,79.0,69.0,99.0
+[13:12:35] len 65512:
+    task,base680,t128,t64
+    niah_single,75.0,54.0,98.0
+[13:12:35] len 131000:
+    task,base680,t128,t64
+    niah_single,36.0,33.0,62.0