Hugging Face's logo

moderntalker
/
efficient_pretrain_checkpoints

Model card Files
xet
 Community
moderntalker commited on
Commit
f4423d2
·
verified ·
1 Parent(s): ac2e10a

Upload intermediate checkpoint for fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 100000

Browse files
Files changed (9) hide show
  1. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-100000/main.pt +3 -0
  2. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-100000/worker_0.pt +3 -0
  3. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-100000/worker_1.pt +3 -0
  4. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-100000/worker_2.pt +3 -0
  5. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-100000/worker_3.pt +3 -0
  6. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-100000/worker_4.pt +3 -0
  7. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-100000/worker_5.pt +3 -0
  8. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-100000/worker_6.pt +3 -0
  9. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-100000/worker_7.pt +3 -0
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-100000/main.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:890ea356b2e89a229e7af044e77f5e60686597723228766bc4f47f49076cc51c
3
+ size 2162396609
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-100000/worker_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a00756416582db97d8745841ca67e6ef9bc0a095fd14042b57203b3436638008
3
+ size 256862
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-100000/worker_1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1999c744124c1127f4f5b42a06fef81b56944e9a489e7b527609d3eccf12bd6c
3
+ size 67742
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-100000/worker_2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:474d4badde11cbbe8cdc41c6270e73762c1ee61d803396e52807452512f2d0d7
3
+ size 27614
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-100000/worker_3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a8d11ddc12eac041eeb0fe9e9007eb98d680e83a9f70a46cc7e91bb87a57cfef
3
+ size 171166
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-100000/worker_4.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:73fbff9a04280687670ad497e97dd3241a01bd73b7c3d17b5be159f019c9ab7d
3
+ size 136030
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-100000/worker_5.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:befd04743982f127716927a8049fd8cb70578eafc5b03f2d65bdb5727507af11
3
+ size 110046
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-100000/worker_6.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:765b63305104f86b713c54109bda670d769bdc9c2e2a0e92a3709fac274ef451
3
+ size 172382
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-100000/worker_7.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0a4df12e064b7272db706818d814181682cc70c5956678f39976e0d6b3881475
3
+ size 33118