Hugging Face's logo

moderntalker
/
efficient_pretrain_checkpoints

Model card Files
xet
 Community
moderntalker commited on
Commit
52324ed
·
verified ·
1 Parent(s): 6281f80

Upload intermediate checkpoint for fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 50000

Browse files
Files changed (3) hide show
  1. intermediate-checkpoints/4C_2gpus/fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-50000/main.pt +3 -0
  2. intermediate-checkpoints/4C_2gpus/fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-50000/worker_0.pt +3 -0
  3. intermediate-checkpoints/4C_2gpus/fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-50000/worker_1.pt +3 -0
intermediate-checkpoints/4C_2gpus/fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-50000/main.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e8bc9fe003e50f2ab07a1e7b9a48a61ad0f6c56c2b9a9e762eeaa9bba79ea607
3
+ size 2513856385
intermediate-checkpoints/4C_2gpus/fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-50000/worker_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b1b6435bb3a5013518e9dfd8cb032dfbb325fc3815db708a9e9c95838eae598a
3
+ size 28190
intermediate-checkpoints/4C_2gpus/fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-50000/worker_1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bc7f26d05c56ffc2ec9726afaf3ff045cd5dc49d77d09f12f4e9280c5d53901c
3
+ size 121118