Hugging Face's logo

moderntalker
/
efficient_pretrain_checkpoints

Model card Files
xet
 Community
efficient_pretrain_checkpoints

Commit History

  1. Upload intermediate checkpoint for fineweb_loro_lr2e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 35325

    moderntalker
    Verified signature
    62b2c46

  2. Upload intermediate checkpoint for fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 15000

    moderntalker
    Verified signature
    8f08b88

  3. Upload intermediate checkpoint for fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 50000

    moderntalker
    Verified signature
    52324ed

  4. Upload intermediate checkpoint for fineweb_loro_lr2e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 15000

    moderntalker
    Verified signature
    6281f80

  5. Upload intermediate checkpoint for fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 35325

    moderntalker
    Verified signature
    c973496

  6. Upload intermediate checkpoint for Resume_67911_fineweb_adamw_lr1e-3_wd1e-4_bf16_grad_clip1e0_2C at iteration 100000

    moderntalker
    Verified signature
    0f9d3b2

  7. Upload intermediate checkpoint for fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 15000

    moderntalker
    Verified signature
    e45a5e1

  1. Upload intermediate checkpoint for Resume_67911_fineweb_adamw_lr1e-3_wd1e-4_bf16_grad_clip1e0_1C at iteration 75457

    moderntalker
    Verified signature
    50a1603

  2. Upload intermediate checkpoint for Resume_67911_fineweb_adamw_lr1e-3_wd1e-4_bf16_grad_clip1e0_1C at iteration 70000

    moderntalker
    Verified signature
    eb5d801

  1. Upload intermediate checkpoint for fineweb_adamw_lr1e-3_wd1e-4_bf16_grad_clip1e0_2C at iteration 67911

    moderntalker
    Verified signature
    9c42843

  1. Upload intermediate checkpoint for fineweb_adamw_lr1e-3_wd1e-4_bf16_grad_clip1e0_2C at iteration 1000

    moderntalker
    Verified signature
    5df5d16

  1. Upload intermediate checkpoint for DEBUG at iteration 300

    moderntalker
    Verified signature
    c4d36da

  2. Upload intermediate checkpoint for DEBUG at iteration 200

    moderntalker
    Verified signature
    bda2880

  3. Upload intermediate checkpoint for DEBUG at iteration 500

    moderntalker
    Verified signature
    cfbdd34

  4. Upload intermediate checkpoint for DEBUG at iteration 100

    moderntalker
    Verified signature
    b73cd39

  1. initial commit

    moderntalker
    Verified signature
    796e157