Hugging Face's logo

moderntalker
/
efficient_pretrain_checkpoints

Model card Files
xet
 Community
moderntalker commited on
Commit
b79a646
·
verified ·
1 Parent(s): 815e1a3

Upload intermediate checkpoint for fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 15000

Browse files
Files changed (9) hide show
  1. intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/main.pt +3 -0
  2. intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/worker_0.pt +3 -0
  3. intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/worker_1.pt +3 -0
  4. intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/worker_2.pt +3 -0
  5. intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/worker_3.pt +3 -0
  6. intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/worker_4.pt +3 -0
  7. intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/worker_5.pt +3 -0
  8. intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/worker_6.pt +3 -0
  9. intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/worker_7.pt +3 -0
intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/main.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c9a00002d8d4fb5bc3abf957c7016bbdb1f16d3cd2d1ff07cf0ff39473da4dfc
3
+ size 2513856385
intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/worker_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b69d6c72b54c44e84206cbdce19aad015ebea49e256679df51c66a5025060284
3
+ size 170974
intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/worker_1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:966ada4126cedb3fcaa349fd131ae302b752a5016ffdda9bd273b7d42174bb47
3
+ size 19678
intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/worker_2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4b4d15ed9a5e5dd50d0d2e7de94c0122410e2d15ed98d276d0a82ba6f1fab1d5
3
+ size 164894
intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/worker_3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3f76c2724dab25571a7571d340a1e0bc3a5b22f4b9aa35870e1e6386856dfe81
3
+ size 92958
intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/worker_4.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3fea9d04dffc54a92922aa4b0ce23cc750ee417c9533e5d5fe2916bdd1a2eb8c
3
+ size 57694
intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/worker_5.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6fd5c8d926353c80ae9a9abfb6ce6cca928039327864c830087ddb4b8da4b67c
3
+ size 51294
intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/worker_6.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fa363c59910940feab66ecd862670674566d3e91747b950d8c8440302a9943bd
3
+ size 114206
intermediate-checkpoints/4C_8gpus/fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-15000/worker_7.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2253c28e99a88a607ed64c08ea027d3c27a2fd09c47e844a5d0a7bd3d25ff5b6
3
+ size 176286