Hugging Face's logo

moderntalker
/
efficient_pretrain_checkpoints

Model card Files
xet
 Community
moderntalker commited on
Commit
1894e42
·
verified ·
1 Parent(s): 81abebc

Upload intermediate checkpoint for fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 35325

Browse files
Files changed (9) hide show
  1. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-35325/main.pt +3 -0
  2. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-35325/worker_0.pt +3 -0
  3. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-35325/worker_1.pt +3 -0
  4. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-35325/worker_2.pt +3 -0
  5. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-35325/worker_3.pt +3 -0
  6. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-35325/worker_4.pt +3 -0
  7. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-35325/worker_5.pt +3 -0
  8. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-35325/worker_6.pt +3 -0
  9. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-35325/worker_7.pt +3 -0
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-35325/main.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a9c96887c989c4d01f593605156355219b54bcbce855841c472844921b9ba64d
3
+ size 2162396545
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-35325/worker_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:be9bd40a941c217cbbe0e8728d402a8ed434b7e3577682fe2e5e913c4cb751e1
3
+ size 240670
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-35325/worker_1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a7868ade905c45a7a9d8f8e31b86e3e301542dd93ca84d2851947c445fbda3a8
3
+ size 128990
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-35325/worker_2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:98164b6429bbe8bbc6b4d876d9883c3fdaa401e7339e1c8f95787b5a5b201e2d
3
+ size 138398
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-35325/worker_3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cf175bd0922ea38877705834487bf101fe940470c2df6b435f0a821b02f81bc9
3
+ size 86558
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-35325/worker_4.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:91cd18382ec6b6b71452cef192e447846174f9861bcc90df9801fb19257ebf51
3
+ size 161374
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-35325/worker_5.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:398cc67196531cc3109153e03255a75bea50fa11624559910d291e39a6161b5f
3
+ size 184158
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-35325/worker_6.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c2cf9b05e61e7b4c16f9197feb4748c79b900b9be96d3a63c32b0d093c785dcd
3
+ size 164574
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-35325/worker_7.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e1c9e69c9fae55e954306314bf9b322f2710c7d541d691598a26455d071e2d22
3
+ size 98462