Hugging Face's logo

moderntalker
/
efficient_pretrain_checkpoints

Model card Files
xet
 Community
moderntalker commited on
Commit
5d9e6c6
·
verified ·
1 Parent(s): 01dff07

Upload intermediate checkpoint for fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 70650

Browse files
Files changed (3) hide show
  1. intermediate-checkpoints/4C_2gpus/fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-70650/main.pt +3 -0
  2. intermediate-checkpoints/4C_2gpus/fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-70650/worker_0.pt +3 -0
  3. intermediate-checkpoints/4C_2gpus/fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-70650/worker_1.pt +3 -0
intermediate-checkpoints/4C_2gpus/fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-70650/main.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ed41f7fc6350ba5bc0a40c5f3eb9643d6b3e8f1a07334cb7019fb8c479e53622
3
+ size 2485688825
intermediate-checkpoints/4C_2gpus/fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-70650/worker_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:958c7bec53e47493b26f0965467547af7c45ffdc779c2473092bea1907ce9279
3
+ size 43102
intermediate-checkpoints/4C_2gpus/fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-70650/worker_1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:45c5836d5fe16841f5ac9162f359196d689ed8c7d36c3b8973195978cb17852c
3
+ size 88030