Hugging Face's logo

moderntalker
/
efficient_pretrain_checkpoints

Model card Files
xet
 Community
moderntalker commited on
Commit
bf19381
·
verified ·
1 Parent(s): 5fa8f13

Upload intermediate checkpoint for Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 100000

Browse files
Files changed (9) hide show
  1. intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-100000/main.pt +3 -0
  2. intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-100000/worker_0.pt +3 -0
  3. intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-100000/worker_1.pt +3 -0
  4. intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-100000/worker_2.pt +3 -0
  5. intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-100000/worker_3.pt +3 -0
  6. intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-100000/worker_4.pt +3 -0
  7. intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-100000/worker_5.pt +3 -0
  8. intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-100000/worker_6.pt +3 -0
  9. intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-100000/worker_7.pt +3 -0
intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-100000/main.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b725c26561431c6dfdbc0c8736997ce6062e4acff55287657b534482b18958ff
3
+ size 3086382138
intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-100000/worker_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e02045351d56aeb45af2cd9e54ae21abb1ee566c424bec93166e71ac3089990d
3
+ size 256862
intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-100000/worker_1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1bb15c89310fa6011d3bc29a4edcf36f1a51c9048fd07b3b536ec122b3da8767
3
+ size 67742
intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-100000/worker_2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9c6e0b717f7d81056591edce74eaf7bd2fb34c2439caea1ad02d75744a426577
3
+ size 27614
intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-100000/worker_3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:027df9211e6d3e2630b06b3b568bfb969e259901fbdba6dbdfed6023dfe1ad95
3
+ size 171166
intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-100000/worker_4.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6e7a89b96377d144bf4be256245ebcb30a6633b075cb1c2737840a3b895b2da5
3
+ size 136030
intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-100000/worker_5.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e8051d00ccea9aa72672224d2ea1fc98f142ec95a2afc2285aa2b272527a9619
3
+ size 110046
intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-100000/worker_6.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:58d20f2ff78b03f1bca6dbff6a75cc41d8f4e4a76c37127a17aef2132b8f5bf4
3
+ size 172382
intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-100000/worker_7.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f3943d84d71379b07f5c4b69491c54aa9042c7836f4f912f1098bfcbf3d2d844
3
+ size 33118