Hugging Face's logo

moderntalker
/
efficient_pretrain_checkpoints

Model card Files
xet
 Community
moderntalker commited on
Commit
15646e2
·
verified ·
1 Parent(s): 365802e

Upload intermediate checkpoint for fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 50000

Browse files
Files changed (9) hide show
  1. intermediate-checkpoints/4C_8gpus/fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-50000/main.pt +3 -0
  2. intermediate-checkpoints/4C_8gpus/fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-50000/worker_0.pt +3 -0
  3. intermediate-checkpoints/4C_8gpus/fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-50000/worker_1.pt +3 -0
  4. intermediate-checkpoints/4C_8gpus/fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-50000/worker_2.pt +3 -0
  5. intermediate-checkpoints/4C_8gpus/fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-50000/worker_3.pt +3 -0
  6. intermediate-checkpoints/4C_8gpus/fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-50000/worker_4.pt +3 -0
  7. intermediate-checkpoints/4C_8gpus/fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-50000/worker_5.pt +3 -0
  8. intermediate-checkpoints/4C_8gpus/fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-50000/worker_6.pt +3 -0
  9. intermediate-checkpoints/4C_8gpus/fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-50000/worker_7.pt +3 -0
intermediate-checkpoints/4C_8gpus/fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-50000/main.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:22bc81ba890315be378ff8db7c159c91592749f840a00c4bf8ff3717a22c52c7
3
+ size 3086382010
intermediate-checkpoints/4C_8gpus/fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-50000/worker_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cb616eb887e1312bbd33bba98b3a968396981cedda79cb503873f06a90bbc457
3
+ size 81886
intermediate-checkpoints/4C_8gpus/fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-50000/worker_1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:26659c30ecde4e9369618ad2482e934ca94980a432190b348299d74cf3937f5f
3
+ size 183902
intermediate-checkpoints/4C_8gpus/fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-50000/worker_2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:62574d7b7cc39e21d81acdcaf04deee0b5c1a6908b51218ae00b34b080b569f1
3
+ size 136158
intermediate-checkpoints/4C_8gpus/fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-50000/worker_3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:da04fd6b8239b06b7c014cacc78e833c9ddcca9bd0ee9fccbc27796c03205d50
3
+ size 167326
intermediate-checkpoints/4C_8gpus/fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-50000/worker_4.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e6d35038604a054bc7ee8c32a60eac1e9d2caef6e289f683fe713622d0ec25ec
3
+ size 60574
intermediate-checkpoints/4C_8gpus/fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-50000/worker_5.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d51e2a35a1927e9c688fd0bea4ee6346f0bb256d2a9ad11aed5e2cea2c58d953
3
+ size 130718
intermediate-checkpoints/4C_8gpus/fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-50000/worker_6.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bb0775d1b87ad6fa248947b3a5732537672e5e4eacec8f1b5be5473fd25bc2ae
3
+ size 72094
intermediate-checkpoints/4C_8gpus/fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-50000/worker_7.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:718db47637f481d809477051bb44e502773d092a01234a8862081894ea9e1a04
3
+ size 42398