unparallelled commited on
Commit
7b498c3
·
verified ·
1 Parent(s): 712018e

Upload logs/t32_master.log with huggingface_hub

Browse files
Files changed (1) hide show
  1. logs/t32_master.log +12 -0
logs/t32_master.log ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [12:45:05] === 680M 32k training at the CORRECTED scale ===
2
+ [12:45:05] parent : p1final (run12 step 1200)
3
+ [12:45:05] data : Data_Loader/Data/t32mix b4=50 b3=30 b1=20, usable 1220 steps, running 1200
4
+ [12:45:05] YaRN : CP_T=32768 SCALE=32 ORIG=4096 -> virtual 0..1023
5
+ [12:45:05] (R2 seq_len != scale*orig warning is EXPECTED and intended)
6
+ [12:45:05] mem : probe peaked 77,397/81,559 MB -- 95%, tight
7
+ [12:45:05] PROBE: 3 steps at the EXACT training config (grad_accum 16)
8
+ [12:46:10] PROBE OK: 3 steps, peak mem: 77397MB, dt dt: 13763.30ms
9
+ [12:46:10] TRAINING 1200 steps
10
+ [16:15:44] done, run 59, loss: 2.542756
11
+ [16:15:44] peak mem mem: 77525MB
12
+ [16:15:44] === 32K TRAINING COMPLETE ===