Hugging Face's logo

moderntalker
/
efficient_pretrain_checkpoints

Model card Files
xet
 Community
moderntalker commited on
Commit
17b7d3e
·
verified ·
1 Parent(s): 718ee29

Upload intermediate checkpoint for fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 141300

Browse files
Files changed (3) hide show
  1. intermediate-checkpoints/4C_2gpus/fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-141300/main.pt +3 -0
  2. intermediate-checkpoints/4C_2gpus/fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-141300/worker_0.pt +3 -0
  3. intermediate-checkpoints/4C_2gpus/fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-141300/worker_1.pt +3 -0
intermediate-checkpoints/4C_2gpus/fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-141300/main.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fddcc63a76a512cb9f78571c898f031024b041a079801d855d2fe8b29948d4aa
3
+ size 2485688825
intermediate-checkpoints/4C_2gpus/fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-141300/worker_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:94a173f2e929d0eba23ab1e0fa6d2816264c7cf0812baee2856fa39ef787dec8
3
+ size 18014
intermediate-checkpoints/4C_2gpus/fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-141300/worker_1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:451b9e51f5efc6432cd09fb454cc06d00a58914b7d49049df5ffc7854510d80e
3
+ size 19934