Hugging Face's logo

moderntalker
/
efficient_pretrain_checkpoints

Model card Files
xet
 Community
moderntalker commited on
Commit
b8305af
·
verified ·
1 Parent(s): 1a39d83

Upload intermediate checkpoint for fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 70650

Browse files
Files changed (3) hide show
  1. intermediate-checkpoints/4C_2gpus/fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-70650/main.pt +3 -0
  2. intermediate-checkpoints/4C_2gpus/fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-70650/worker_0.pt +3 -0
  3. intermediate-checkpoints/4C_2gpus/fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-70650/worker_1.pt +3 -0
intermediate-checkpoints/4C_2gpus/fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-70650/main.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:015634139e70531c72cf3ef229cf953ae345a3a7d56f597dce3e9884943b04bc
3
+ size 2513856385
intermediate-checkpoints/4C_2gpus/fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-70650/worker_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:406ac85ea84bfd879809b93c151e7752a9baf55bbb37c38efb63efafafac3d58
3
+ size 43102
intermediate-checkpoints/4C_2gpus/fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-70650/worker_1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ea4e2597b6e00ebc7c3e74ca24c930db16279301ed5d49e2ab7dd26016c1aa17
3
+ size 88030