Hugging Face's logo

moderntalker
/
efficient_pretrain_checkpoints

Model card Files
xet
 Community
moderntalker commited on
Commit
365802e
·
verified ·
1 Parent(s): f632a84

Upload intermediate checkpoint for Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 35325

Browse files
Files changed (9) hide show
  1. intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-35325/main.pt +3 -0
  2. intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-35325/worker_0.pt +3 -0
  3. intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-35325/worker_1.pt +3 -0
  4. intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-35325/worker_2.pt +3 -0
  5. intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-35325/worker_3.pt +3 -0
  6. intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-35325/worker_4.pt +3 -0
  7. intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-35325/worker_5.pt +3 -0
  8. intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-35325/worker_6.pt +3 -0
  9. intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-35325/worker_7.pt +3 -0
intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-35325/main.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:48de370569a634e6ac4035584841c218e1f3f0d00bf136fc089ae9fe10f64821
3
+ size 3086382138
intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-35325/worker_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d6761a20015ee7a7ec09bdc8d51ffa44f068191fa9edd1e31ac8dffec8dde6b3
3
+ size 240670
intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-35325/worker_1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7bba270c3f600e0f2609c6984d464ef3c8d64739a5f481afb3416133dbb4b2fb
3
+ size 128990
intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-35325/worker_2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c93580579455ad7640ada03f157916ff360d16e66785ad85f4dcb1a5729d634e
3
+ size 138398
intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-35325/worker_3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:368195f57c34da5bcb093d4cb04ed629b50791af3c7c584cc3f81dd0eabd0ae9
3
+ size 86558
intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-35325/worker_4.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a25142b242fee614b06193fd447105271299d744caf3c6a78899365342a91725
3
+ size 161374
intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-35325/worker_5.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1762462c5b2cd27b1196e6e49a8065b5b69e84953d49c5ac6a50ed38228ddc63
3
+ size 184158
intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-35325/worker_6.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c8971ab38c7b6959db9964fb0a887c0c84e7af7fd5426c8ac8c0f3b77d5a81ea
3
+ size 164574
intermediate-checkpoints/4C_8gpus/Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-35325/worker_7.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dde6046ddb2a2fea0a6d77235516692de5985c4c9146b59405da84f56db5af9a
3
+ size 98462