Hugging Face's logo

moderntalker
/
efficient_pretrain_checkpoints

Model card Files
xet
 Community
moderntalker commited on
Commit
de56ad0
·
verified ·
1 Parent(s): b8305af

Upload intermediate checkpoint for fineweb_loro_lr2e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 50000

Browse files
Files changed (3) hide show
  1. intermediate-checkpoints/4C_2gpus/fineweb_loro_lr2e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-50000/main.pt +3 -0
  2. intermediate-checkpoints/4C_2gpus/fineweb_loro_lr2e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-50000/worker_0.pt +3 -0
  3. intermediate-checkpoints/4C_2gpus/fineweb_loro_lr2e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-50000/worker_1.pt +3 -0
intermediate-checkpoints/4C_2gpus/fineweb_loro_lr2e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-50000/main.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:791f2f346a4f8eaadf78785e9daba7c3198ce653d8a36b0c3e5704cee5f57504
3
+ size 2485688377
intermediate-checkpoints/4C_2gpus/fineweb_loro_lr2e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-50000/worker_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:96b84677ecc1d8688104c9bddd8a339d67ca8d6147f5f051af0c6b5f8e2ff0c1
3
+ size 28190
intermediate-checkpoints/4C_2gpus/fineweb_loro_lr2e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-50000/worker_1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:195682dca18cde1d70fa4e32aad6362b93bfb16c38d0a3acde4f206a3a33dcce
3
+ size 121118