Hugging Face's logo

moderntalker
/
efficient_pretrain_checkpoints

Model card Files
xet
 Community
moderntalker commited on
Commit
dfb086b
·
verified ·
1 Parent(s): 2b12876

Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_bf16_grad_clip1e0_4C at iteration 141300

Browse files
Files changed (3) hide show
  1. intermediate-checkpoints/4C_2gpus/fineweb_slim_adam_lr5e-4_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-141300/main.pt +3 -0
  2. intermediate-checkpoints/4C_2gpus/fineweb_slim_adam_lr5e-4_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-141300/worker_0.pt +3 -0
  3. intermediate-checkpoints/4C_2gpus/fineweb_slim_adam_lr5e-4_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-141300/worker_1.pt +3 -0
intermediate-checkpoints/4C_2gpus/fineweb_slim_adam_lr5e-4_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-141300/main.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:551e0a1c0d5eb6a11b870be846b1ee7048c17d900f9d31e11461868ca2b10340
3
+ size 2674684325
intermediate-checkpoints/4C_2gpus/fineweb_slim_adam_lr5e-4_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-141300/worker_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6120e88caf0cc74f8b41f236bc7fe4f1ca0b6847357d7b9de7f5522e56e0a98d
3
+ size 18014
intermediate-checkpoints/4C_2gpus/fineweb_slim_adam_lr5e-4_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-141300/worker_1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e6ccfd33705ea72888088c854ee1565c22bf103c8831f27caea1ddf44fe92bb
3
+ size 19934