Hugging Face's logo

moderntalker
/
efficient_pretrain_checkpoints

Model card Files
xet
 Community
moderntalker commited on
Commit
88979af
·
verified ·
1 Parent(s): c29369e

Upload intermediate checkpoint for fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 141300

Browse files
Files changed (9) hide show
  1. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/main.pt +3 -0
  2. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/worker_0.pt +3 -0
  3. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/worker_1.pt +3 -0
  4. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/worker_2.pt +3 -0
  5. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/worker_3.pt +3 -0
  6. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/worker_4.pt +3 -0
  7. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/worker_5.pt +3 -0
  8. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/worker_6.pt +3 -0
  9. intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/worker_7.pt +3 -0
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/main.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b643b860b8f9638bd01b5081c9fd6982298489b8d916537b6b7b9f8350b191c6
3
+ size 2162396609
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/worker_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c29619b769a8d9e7cfe17bcd21a6094408dc95264a08b5b142e285f4e46cac69
3
+ size 147742
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/worker_1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:64b4b03443e4ab75e2b1663b118bc6a72284026266472bec92cffde34ff800b6
3
+ size 31326
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/worker_2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c187f2582020900ca6d55c8b24713eafde3d3307d51b58f7a1eb6fbe0aa07351
3
+ size 118814
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/worker_3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5b1e5014540c10738e0265c11fc448a25fb9c047c4e107b54d89759fa4a5e42e
3
+ size 62878
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/worker_4.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cd1d96b79e4d9377aa322ac92da68348dcc05137359835f910dbccaa402a675b
3
+ size 89822
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/worker_5.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7260462b67914df99e48aaa0f7ac559679b0890352f8537198dddbb1cb106809
3
+ size 130782
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/worker_6.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c532b082bec39fee944c70d3fd8ad9f45427a0805e54ced895fb8761353a6740
3
+ size 94174
intermediate-checkpoints/4C_8gpus/fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C/inter-ckpt-141300/worker_7.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:955f8e1bec938cd4d1cc1a484bd1b792f29cc35005a5e4e6cbf093fcc35d1675
3
+ size 120990