Hugging Face's logo

moderntalker
/
efficient_pretrain_checkpoints

Model card Files
xet
 Community
moderntalker commited on
Commit
e45a5e1
·
verified ·
1 Parent(s): 50a1603

Upload intermediate checkpoint for fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 15000

Browse files
Files changed (3) hide show
  1. intermediate-checkpoints/4C_2gpus/fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-15000/main.pt +3 -0
  2. intermediate-checkpoints/4C_2gpus/fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-15000/worker_0.pt +3 -0
  3. intermediate-checkpoints/4C_2gpus/fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-15000/worker_1.pt +3 -0
intermediate-checkpoints/4C_2gpus/fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-15000/main.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d2cbdade5ae7aba2df99da8ea43618a6921776bf0fa431b4aa6e041a6fbff4c0
3
+ size 2513856385
intermediate-checkpoints/4C_2gpus/fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-15000/worker_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7226b09d04483b617bbb8c92c8e945ba6ba4ce4906e8fc85646aa940dc66ea74
3
+ size 76126
intermediate-checkpoints/4C_2gpus/fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-15000/worker_1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d5fb73cfcb1947a922bd86805c396cf7eaa02fff0d044857db8d6f0873b034f4
3
+ size 204958