Hugging Face's logo

moderntalker
/
efficient_pretrain_checkpoints

Model card Files
xet
 Community
moderntalker commited on
Commit
4408b01
·
verified ·
1 Parent(s): c4b3088

Upload intermediate checkpoint for fineweb_apollo_adamw_lr2e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 50000

Browse files
Files changed (9) hide show
  1. intermediate-checkpoints/4C_8gpus/fineweb_apollo_adamw_lr2e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-50000/main.pt +3 -0
  2. intermediate-checkpoints/4C_8gpus/fineweb_apollo_adamw_lr2e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-50000/worker_0.pt +3 -0
  3. intermediate-checkpoints/4C_8gpus/fineweb_apollo_adamw_lr2e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-50000/worker_1.pt +3 -0
  4. intermediate-checkpoints/4C_8gpus/fineweb_apollo_adamw_lr2e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-50000/worker_2.pt +3 -0
  5. intermediate-checkpoints/4C_8gpus/fineweb_apollo_adamw_lr2e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-50000/worker_3.pt +3 -0
  6. intermediate-checkpoints/4C_8gpus/fineweb_apollo_adamw_lr2e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-50000/worker_4.pt +3 -0
  7. intermediate-checkpoints/4C_8gpus/fineweb_apollo_adamw_lr2e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-50000/worker_5.pt +3 -0
  8. intermediate-checkpoints/4C_8gpus/fineweb_apollo_adamw_lr2e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-50000/worker_6.pt +3 -0
  9. intermediate-checkpoints/4C_8gpus/fineweb_apollo_adamw_lr2e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-50000/worker_7.pt +3 -0
intermediate-checkpoints/4C_8gpus/fineweb_apollo_adamw_lr2e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-50000/main.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b492a28e1f94ae4b0ff5bd1bb1a2cd92afeaae86a4229236eaceb354ed5ca4bb
3
+ size 2249640861
intermediate-checkpoints/4C_8gpus/fineweb_apollo_adamw_lr2e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-50000/worker_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cb616eb887e1312bbd33bba98b3a968396981cedda79cb503873f06a90bbc457
3
+ size 81886
intermediate-checkpoints/4C_8gpus/fineweb_apollo_adamw_lr2e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-50000/worker_1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:26659c30ecde4e9369618ad2482e934ca94980a432190b348299d74cf3937f5f
3
+ size 183902
intermediate-checkpoints/4C_8gpus/fineweb_apollo_adamw_lr2e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-50000/worker_2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:62574d7b7cc39e21d81acdcaf04deee0b5c1a6908b51218ae00b34b080b569f1
3
+ size 136158
intermediate-checkpoints/4C_8gpus/fineweb_apollo_adamw_lr2e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-50000/worker_3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:da04fd6b8239b06b7c014cacc78e833c9ddcca9bd0ee9fccbc27796c03205d50
3
+ size 167326
intermediate-checkpoints/4C_8gpus/fineweb_apollo_adamw_lr2e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-50000/worker_4.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e6d35038604a054bc7ee8c32a60eac1e9d2caef6e289f683fe713622d0ec25ec
3
+ size 60574
intermediate-checkpoints/4C_8gpus/fineweb_apollo_adamw_lr2e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-50000/worker_5.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d51e2a35a1927e9c688fd0bea4ee6346f0bb256d2a9ad11aed5e2cea2c58d953
3
+ size 130718
intermediate-checkpoints/4C_8gpus/fineweb_apollo_adamw_lr2e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-50000/worker_6.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bb0775d1b87ad6fa248947b3a5732537672e5e4eacec8f1b5be5473fd25bc2ae
3
+ size 72094
intermediate-checkpoints/4C_8gpus/fineweb_apollo_adamw_lr2e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-50000/worker_7.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:718db47637f481d809477051bb44e502773d092a01234a8862081894ea9e1a04
3
+ size 42398