Hugging Face's logo

rubentium
/
sparse-checkpoints

Model card Files
xet
 Community
sparse-checkpoints / checkpoints

Commit History

14 days ago

  1. Upload Part 5 Dense 8k twin seed 42 checkpoint step 44000

    rubentium
    Verified signature
    9bcada6

  2. Upload Part 5 Dense16k seed 42 final checkpoint step 22000

    rubentium
    Verified signature
    78bad5a

  3. Upload Part T Mixed seed 70 final checkpoint step 50462

    rubentium
    Verified signature
    5cc0d45

  4. Upload Part T Dense seed 70 final checkpoint step 50462

    rubentium
    Verified signature
    c19b704

16 days ago

  1. Add 1.2B Dense seed-70 step-25000 resume checkpoint for RCP transfer

    rubentium
    Verified signature
    aa8d5fc

  1. Add final paper checkpoint: checkpoints/scale_1p2b_current/l8k1p2b_mixed_seed72/checkpoint-50462

    rubentium
    Verified signature
    ed534a8

  2. Add final paper checkpoint: checkpoints/scale_1p2b_current/l8k1p2b_dense_seed72_repaired/checkpoint-50462

    rubentium
    Verified signature
    9821067

  3. Add final paper checkpoint: checkpoints/scale_1p2b_current/l8k1p2b_mixed_seed71/checkpoint-50462

    rubentium
    Verified signature
    08adb78

  4. Add final paper checkpoint: checkpoints/scale_1p2b_current/l8k1p2b_mixed_seed70_repaired/checkpoint-50462

    rubentium
    Verified signature
    874cc3d

  5. Add final paper checkpoint: checkpoints/scale_1p2b_current/l8k1p2b_dense_seed70/checkpoint-50462

    rubentium
    Verified signature
    4189812

  6. Add final paper checkpoint: checkpoints/scale_1p2b_factorial/l8k1_2b_dense_legacy42/checkpoint-50462

    rubentium
    Verified signature
    41ad231

  1. Upload paper checkpoint l30k1_2b_resampled checkpoint-37465

    rubentium
    Verified signature
    fdfbf05

  2. Upload paper checkpoint l30k1_2b_fixed checkpoint-37465

    rubentium
    Verified signature
    d851b02

  3. Upload paper checkpoint l30k1_2b_mixed checkpoint-37465

    rubentium
    Verified signature
    50d251b

  4. Upload paper checkpoint l30k1_2b_dense checkpoint-37465

    rubentium
    Verified signature
    0188de4

  5. Upload paper checkpoint l8k1_2b_mixed checkpoint-50462

    rubentium
    Verified signature
    86ec5f1

  6. Upload paper checkpoint l8k3b_mixed_60b checkpoint-100000

    rubentium
    Verified signature
    f16ddfc

  7. Upload paper checkpoint l8k3b_dense_60b checkpoint-100000

    rubentium
    Verified signature
    20aef72

  8. Upload paper checkpoint l8k1p2b_dense_seed71 checkpoint-50462

    rubentium
    Verified signature
    c59faac

  9. Upload paper checkpoint l8k1p2b_mixed_seed70 checkpoint-48962

    rubentium
    Verified signature
    be6e336

  10. Upload paper checkpoint l8k365m_dense_ropectl_a1p0_seed46 checkpoint-44000

    rubentium
    Verified signature
    34b4e9a

  11. Upload paper checkpoint l8k365m_dense_ropectl_a1p0_seed45 checkpoint-44000

    rubentium
    Verified signature
    f7a9c97

  12. Upload paper checkpoint l8k365m_dense_ropectl_a1p0_seed44 checkpoint-44000

    rubentium
    Verified signature
    2005d11

  13. Upload paper checkpoint l8k365m_dense_ropectl_a1p0_seed43 checkpoint-44000

    rubentium
    Verified signature
    6d1b435

  14. Upload paper checkpoint l8k365m_dense_ropectl_a1p0_seed42 checkpoint-44000

    rubentium
    Verified signature
    cb26bd4

  15. Upload paper checkpoint l8k365m_dense_dropout_p28_seed46 checkpoint-44000

    rubentium
    Verified signature
    2532505

  16. Upload paper checkpoint l8k365m_dense_dropout_p28_seed45 checkpoint-44000

    rubentium
    Verified signature
    f751983

  17. Upload paper checkpoint l8k365m_dense_dropout_p28_seed44 checkpoint-44000

    rubentium
    Verified signature
    a7e6cdd

  18. Upload paper checkpoint l8k365m_dense_dropout_p28_seed43 checkpoint-44000

    rubentium
    Verified signature
    758ea38

  19. Upload paper checkpoint l8k365m_dense_dropout_p28_seed42 checkpoint-44000

    rubentium
    Verified signature
    04caa16

  20. Upload paper checkpoint l8k365m_dense_seed47 checkpoint-44000

    rubentium
    Verified signature
    50b87e8

  21. Upload paper checkpoint l8k365m_dense_seed46 checkpoint-44000

    rubentium
    Verified signature
    b1eb76c

  22. Upload paper checkpoint l8k365m_dense_seed45 checkpoint-44000

    rubentium
    Verified signature
    13f47ba

  23. Upload paper checkpoint l8k365m_dense_seed44 checkpoint-44000

    rubentium
    Verified signature
    14562ef

  24. Upload paper checkpoint l8k365m_dense_seed43 checkpoint-44000

    rubentium
    Verified signature
    5ec83e5

  25. Upload paper checkpoint l8k365m_dense checkpoint-44000

    rubentium
    Verified signature
    370e937

  26. Upload paper checkpoint l8k365m_mixed_seed47 checkpoint-44000

    rubentium
    Verified signature
    d547d75

  27. Upload paper checkpoint l8k365m_mixed_seed46 checkpoint-44000

    rubentium
    Verified signature
    d2d9839

  28. Upload paper checkpoint l8k365m_mixed_seed45 checkpoint-44000

    rubentium
    Verified signature
    69e46ee

  29. Upload paper checkpoint l8k365m_mixed_seed44 checkpoint-44000

    rubentium
    Verified signature
    c41d02d

  30. Upload paper checkpoint l8k365m_mixed_seed43 checkpoint-44000

    rubentium
    Verified signature
    0cd308c

  31. Upload paper checkpoint l8k365m_mixed_seed42 checkpoint-44000

    rubentium
    Verified signature
    4144326