Upload logs/mixcont/ppl_degraded_g1400.log with huggingface_hub

logs/mixcont/ppl_degraded_g1400.log

@@ -0,0 +1,57 @@
+=== Llama Context Parallel Training Script (bluscriptCP) ===
+[CP attn fusion] split (Stage-2 rope-once + Stage-3 Hopper causal-attn kernels)
+[watchdog] collective no-progress deadline 600 s, poll 2 s (BLU_NCCL_WATCHDOG=0 to disable)
+[watchdog] collective no-progress deadline 600 s, poll 2 s (BLU_NCCL_WATCHDOG=0 to disable)
+================ Configuration (bluscriptCP) ================
+  d_model/layers  : 1536 / 36
+  q/kv heads      : 12 / 4  (G=3, hd=128)
+  ffn_hidden      : 4096 (SwiGLU)
+  context_length  : 65536
+  vocab_size      : 50304  tying=0
+  B x T           : 1 x 65536
+  world_size      : 8  (dp=1 x cp=8)
+  CP_ATTN_MODE    : ring  (load_balance=HeadTail)
+  global_batch    : 65536  (grad_accum=1)
+  precision       : bf16 Linears + fp32 norms/residual/logits (fp32 master weights in AdamW)  [mask=15 QKV WO MLP HEAD]
+  max_lr/min_lr   : 0.0006 / 6e-05
+  warmup/steps    : 91 / 1  (cosine, no stable phase)
+  checkpointing   : true  (ckpt_freq=50, dir=checkpoints_bluscriptcp)
+=============================================================
+Initializing model on CUDA device 0...
+[YaRN] build_rope_cache: seq_len=65536 hd=128 scale=2.000 low=24 high=42 m=1.0693
+[InitFrom] weights loaded from /root/Adhi/BluTrain/dist/Context_Parallelism/checkpoints_bluscriptcp/rank_0/cliff_g1400.ckpt  (base step 200, loss 2.42209)  -- optimizer state and RNG intentionally NOT restored; pair with CP_REWARMUP
+Parameters: 1060624896
+Parameters per GPU: 1060624896
+max_steps: 1
+warmup_steps: 91
+[ZeRO-1 v2] build=v2.4  supports: rs+ag | can-symmetric-window | can-fp32-reduce | can-bf16-reduce | can-reshard-v1-ckpt
+[ZeRO-1 v2] ACTIVE: reduce_dtype=bfloat16 (= param dtype)  symmetric=off  overlap=-/-
+[ZeRO-1 v2] zero1-v2 reduce-scatter/all-gather (standard memory)
+[ZeRO-1 v2] params=983236608 padded=983236608 W=8 shard=122904576 | 38 buckets of 50 MB (3276800 elems/rank/bucket) | optimizer state/GPU: 1406.53 MB (vs 11252.2 MB unsharded)
+[ZeRO-1 v2] NOTE: symmetric memory is NOT active — collectives will run NCCL's ring/tree path, not NVLS. Create the process group with MemoryMode::Symmetric (and NCCL >= 2.27) to enable it.
+[ZeRO-1 v2] build=v2.4  supports: rs+ag | can-symmetric-window | can-fp32-reduce | can-bf16-reduce | can-reshard-v1-ckpt
+[ZeRO-1 v2] ACTIVE: reduce_dtype=float32 (= param dtype)  symmetric=off  overlap=-/-
+[ZeRO-1 v2] zero1-v2 reduce-scatter/all-gather (standard memory)
+[ZeRO-1 v2] params=77388288 padded=77388288 W=8 shard=9673536 | 6 buckets of 50 MB (1638400 elems/rank/bucket) | optimizer state/GPU: 110.705 MB (vs 885.639 MB unsharded)
+[ZeRO-1 v2] NOTE: symmetric memory is NOT active — collectives will run NCCL's ring/tree path, not NVLS. Create the process group with MemoryMode::Symmetric (and NCCL >= 2.27) to enable it.
+[ZeRO-1] variant=v2 reduce-scatter/all-gather  groups=2  [bfloat16/983236608]  [float32/77388288]
+[ZeRO-1] DataParallel is DISABLED (both would double-reduce)
+[precision] bf16 params=217, all with fp32 master weights
+found 12 shards for split train
+found 1 shards for split val
+[Resume] latest run 2 already complete at step 200; starting a new run.
+Saving logs to: CP_BluScreipt_Training_logs/CP_Training_log7.csv (run 7)
+[rope_theta] 500000 compiled default (no sidecar -- legacy run, assuming it was trained at this base)
+Checkpointing: ON -> checkpoints_bluscriptcp/blumodelcp_run7_step_<N>.ckpt (every 50 steps, keep 6)
+[eval] PPL-vs-position: 8 windows (skip=0) x B=1 Tglobal=65536 Tlocal=8192 cp=8 (YARN_SCALE via env) -> mixcont_logs/ppl_degraded1400.csv
+[eval] per-position NLL: GPU
+[CP ring P2P] OVERLAP: dedicated non-blocking stream
+[eval] window 1/8 done
+[eval] window 2/8 done
+[eval] window 3/8 done
+[eval] window 4/8 done
+[eval] window 5/8 done
+[eval] window 6/8 done
+[eval] window 7/8 done
+[eval] window 8/8 done
+[eval] wrote mixcont_logs/ppl_degraded1400.csv (65536 positions, 8 windows)