Hugging Face's logo

moderntalker
/
efficient_pretrain_checkpoints

Model card Files
xet
 Community
moderntalker commited on
Commit
73104e2
·
verified ·
1 Parent(s): 248d9ef

Upload intermediate checkpoint for fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 70650

Browse files
Files changed (9) hide show
  1. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-70650/main.pt +3 -0
  2. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-70650/worker_0.pt +3 -0
  3. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-70650/worker_1.pt +3 -0
  4. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-70650/worker_2.pt +3 -0
  5. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-70650/worker_3.pt +3 -0
  6. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-70650/worker_4.pt +3 -0
  7. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-70650/worker_5.pt +3 -0
  8. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-70650/worker_6.pt +3 -0
  9. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-70650/worker_7.pt +3 -0
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-70650/main.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aebb914a1c749d39c70445541d2c438f787317e6a9c2f6a496d4f51bb9585d27
3
+ size 2162396609
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-70650/worker_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:27aba7f7eb05189048a425f3bc94e867c4d98bc731de0e7f98f9bb9a18701524
3
+ size 120990
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-70650/worker_1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:455edb380bc515d8f463fb7858333f3b8e55a5abb6f999a5d4b4d82932564ac3
3
+ size 150558
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-70650/worker_2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:99ad576b3fcc7a7eb91c7aae0008b886fa10f7c0ab3ec019c360f9d7fb2f0ada
3
+ size 56798
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-70650/worker_3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:633cdc01d9dcd82d7831fc9b76fde8c44252b4c392db69bab85e96e893b4f205
3
+ size 277022
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-70650/worker_4.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:89d722d7d7ffc70d98fd627168080a86545371b8c536152a0f4448013dea3a69
3
+ size 51422
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-70650/worker_5.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:75a65c043d7c7306545b7791904da55d1d5ce4776bbcd0c87766f10640db49b6
3
+ size 95390
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-70650/worker_6.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:46cb0a3ab1a7381de340cccea9d80b81a9a9b4e7980908d074bb315cd9f914a8
3
+ size 31646
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-70650/worker_7.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:66f202b1c0ad07a500613bb3c9fb3feaf06fe6d4921ca225016951116d3334ce
3
+ size 186654