Hugging Face's logo

moderntalker
/
efficient_pretrain_checkpoints

Model card Files
xet
 Community
moderntalker commited on
Commit
060a0b4
·
verified ·
1 Parent(s): 65ce22a

Upload intermediate checkpoint for fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 15000

Browse files
Files changed (9) hide show
  1. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/main.pt +3 -0
  2. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/worker_0.pt +3 -0
  3. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/worker_1.pt +3 -0
  4. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/worker_2.pt +3 -0
  5. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/worker_3.pt +3 -0
  6. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/worker_4.pt +3 -0
  7. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/worker_5.pt +3 -0
  8. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/worker_6.pt +3 -0
  9. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/worker_7.pt +3 -0
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/main.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d3f52400471139308481ee99d733fb3d3b5171297093e6b45b6a7591bb424c96
3
+ size 2162396545
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/worker_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:73b393c2f729616b260353d518e63e4c8be7a53d32c0b6c8f241dcbc15e78bf0
3
+ size 170974
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/worker_1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2fab05ebb1882580597aa351179387e42f39c60ea0df5583d65a4abc7de82da9
3
+ size 19678
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/worker_2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c7e5373631873187cd113f1eaf62d8aa9d4a3c7420667b3d01bfbdc0c4ee438
3
+ size 164894
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/worker_3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d1fa2f5d34481bcd8a75cb09bd8b477e613cc5bb119c4e23f39118c7c58df0a6
3
+ size 92958
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/worker_4.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:20c53af45ff1c97af7347de8cd43c4c4e710af84aa96b159972de92608b6b0d2
3
+ size 57694
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/worker_5.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f824226f4da045839c7226526d6f52d586aababbfae1f4e948a8a17fd4c80aa9
3
+ size 51294
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/worker_6.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:942f0dc8064f9c52aafe6bade6422841a34b7ae40ffc38266102bdba4172850f
3
+ size 114206
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/worker_7.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0fb8cdafc6ea338e0e553053cfec03f32f1dba5d92d1579bb2c39f0c320128ee
3
+ size 176286