Hugging Face's logo

moderntalker
/
efficient_pretrain_checkpoints

Model card Files
xet
 Community
moderntalker commited on
Commit
361aac3
·
verified ·
1 Parent(s): db815f6

Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_bf16_grad_clip1e0_4C at iteration 35325

Browse files
Files changed (3) hide show
  1. intermediate-checkpoints/4C_2gpus/fineweb_slim_adam_lr5e-4_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-35325/main.pt +3 -0
  2. intermediate-checkpoints/4C_2gpus/fineweb_slim_adam_lr5e-4_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-35325/worker_0.pt +3 -0
  3. intermediate-checkpoints/4C_2gpus/fineweb_slim_adam_lr5e-4_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-35325/worker_1.pt +3 -0
intermediate-checkpoints/4C_2gpus/fineweb_slim_adam_lr5e-4_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-35325/main.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c10aa816b6a93a54ac174dd13eaaa6959f1c943a89333aa949bd789b09fc902
3
+ size 2674684069
intermediate-checkpoints/4C_2gpus/fineweb_slim_adam_lr5e-4_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-35325/worker_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:42914c33281e79236c6bf5098a14587b3ee9681bde4d354e62b7e81759a9bd1d
3
+ size 112542
intermediate-checkpoints/4C_2gpus/fineweb_slim_adam_lr5e-4_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-35325/worker_1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6bdc1b3e161fec736e36fc55de8b3ceccc58d879d3f0e10222080a63f1971f5e
3
+ size 67166