Hugging Face's logo

moderntalker
/
efficient_pretrain_checkpoints

Model card Files
xet
 Community
efficient_pretrain_checkpoints / intermediate-checkpoints /4C_2gpus

Commit History

  1. Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_bf16_grad_clip1e0_4C at iteration 157000

    moderntalker
    Verified signature
    a761b1b

  2. Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_bf16_grad_clip1e0_4C at iteration 141300

    moderntalker
    Verified signature
    dfb086b

  3. Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_bf16_grad_clip1e0_4C at iteration 100000

    moderntalker
    Verified signature
    b61d369

  1. Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_bf16_grad_clip1e0_4C at iteration 70650

    moderntalker
    Verified signature
    5f33312

  2. Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_bf16_grad_clip1e0_4C at iteration 50000

    moderntalker
    Verified signature
    8b06f49

  3. Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_bf16_grad_clip1e0_4C at iteration 35325

    moderntalker
    Verified signature
    361aac3

  4. Upload intermediate checkpoint for fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 157000

    moderntalker
    Verified signature
    2b464dd

  5. Upload intermediate checkpoint for fineweb_loro_lr2e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 15000

    moderntalker
    Verified signature
    1ade569

  6. Upload intermediate checkpoint for fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 141300

    moderntalker
    Verified signature
    17b7d3e

  7. Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_bf16_grad_clip1e0_4C at iteration 15000

    moderntalker
    Verified signature
    718ee29

  8. Upload intermediate checkpoint for fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 157000

    moderntalker
    Verified signature
    f6177d5

  1. Upload intermediate checkpoint for fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 141300

    moderntalker
    Verified signature
    6942491

  2. Upload intermediate checkpoint for fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 100000

    moderntalker
    Verified signature
    00570f5

  3. Upload intermediate checkpoint for fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 100000

    moderntalker
    Verified signature
    5a6dcad

  4. Upload intermediate checkpoint for fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 70650

    moderntalker
    Verified signature
    5d9e6c6

  1. Upload intermediate checkpoint for fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 50000

    moderntalker
    Verified signature
    01dff07

  2. Upload intermediate checkpoint for fineweb_loro_lr2e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 50000

    moderntalker
    Verified signature
    de56ad0

  3. Upload intermediate checkpoint for fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 70650

    moderntalker
    Verified signature
    b8305af

  4. Upload intermediate checkpoint for fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 35325

    moderntalker
    Verified signature
    1a39d83

  5. Upload intermediate checkpoint for fineweb_loro_lr2e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 35325

    moderntalker
    Verified signature
    62b2c46

  6. Upload intermediate checkpoint for fineweb_loro_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 15000

    moderntalker
    Verified signature
    8f08b88

  7. Upload intermediate checkpoint for fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 50000

    moderntalker
    Verified signature
    52324ed

  8. Upload intermediate checkpoint for fineweb_loro_lr2e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 15000

    moderntalker
    Verified signature
    6281f80

  9. Upload intermediate checkpoint for fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 35325

    moderntalker
    Verified signature
    c973496

  10. Upload intermediate checkpoint for fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 15000

    moderntalker
    Verified signature
    e45a5e1