Upload logs/t128_probe_OOM.log with huggingface_hub
Browse files- logs/t128_probe_OOM.log +8 -0
logs/t128_probe_OOM.log
ADDED
|
@@ -0,0 +1,8 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
[08:04:08] === 680M 131k extension, 8x H100, cp=8 dp=1 ===
|
| 2 |
+
[08:04:08] parent : t64 (98 @65,512 -- the 64k model, staged ladder)
|
| 3 |
+
[08:04:08] YaRN : SCALE=32 x ORIG=4096 = 131072 == CP_T INVARIANT HOLDS
|
| 4 |
+
[08:04:08] virtual range 0..4095 (full), 32 tokens/virtual unit
|
| 5 |
+
[08:04:08] LR : peak 1.8e-4 (6e-4 x 0.3), warmup 100 / stable 900 / DECAY 200 -> 6e-5
|
| 6 |
+
[08:04:08] data : Data_Loader/Data/mix128 b6=8.9 b5=39 b4=25 b3=15 b1=10, usable 1219 steps, running 1200
|
| 7 |
+
[08:04:08] PROBE cp=8 (16384 tok/rank, grad_accum 4)
|
| 8 |
+
[08:05:08] FATAL: PROBE OOM at cp=8
|