Hugging Face's logo

moderntalker
/
efficient_pretrain_checkpoints

Model card Files
xet
 Community
moderntalker commited on
Commit
00570f5
·
verified ·
1 Parent(s): acb08c9

Upload intermediate checkpoint for fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 100000

Browse files
Files changed (3) hide show
  1. intermediate-checkpoints/4C_2gpus/fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-100000/main.pt +3 -0
  2. intermediate-checkpoints/4C_2gpus/fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-100000/worker_0.pt +3 -0
  3. intermediate-checkpoints/4C_2gpus/fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-100000/worker_1.pt +3 -0
intermediate-checkpoints/4C_2gpus/fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-100000/main.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:57806f10544708ee5cb2f25fa2e299c93a891e901811fa4c5087382e4bcdab16
3
+ size 2485688825
intermediate-checkpoints/4C_2gpus/fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-100000/worker_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cd41fc796df7b2d7b3b9ec6c7a2d2390c9a1ff7d748559645dc127c257acb14f
3
+ size 31070
intermediate-checkpoints/4C_2gpus/fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-100000/worker_1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:38b637f4e892a582cf5d95f9fc20695f6296afb815ee6978f20eac21cdf100b7
3
+ size 99806