Hugging Face's logo

moderntalker
/
efficient_pretrain_checkpoints

Model card Files
xet
 Community
moderntalker commited on
Commit
8f08b88
·
verified ·
1 Parent(s): 52324ed

Upload intermediate checkpoint for fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 15000

Browse files
Files changed (3) hide show
  1. intermediate-checkpoints/4C_2gpus/fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-15000/main.pt +3 -0
  2. intermediate-checkpoints/4C_2gpus/fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-15000/worker_0.pt +3 -0
  3. intermediate-checkpoints/4C_2gpus/fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-15000/worker_1.pt +3 -0
intermediate-checkpoints/4C_2gpus/fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-15000/main.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f5590a44d93719ec6e34e5d9ef9bc7d28fba8941c74051a096a0061dcd146b3a
3
+ size 2485688377
intermediate-checkpoints/4C_2gpus/fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-15000/worker_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:926a84db555fb4b3225ae6bfe3062fd1b7ea6cf0d2938a39582882e19ec29dc7
3
+ size 76126
intermediate-checkpoints/4C_2gpus/fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-15000/worker_1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dd7213de48bae81dd42a469e329fd613de8286e1315c8c5d264670b07752a261
3
+ size 204958