Commit History

2 days ago

  1. Upload 2 files

    Verified signature
    c87431e
  2. Update README.md⁠

    Verified signature
    6041e5b
  3. Add model card and benchmark report

    Verified signature
    19de994
  4. SFT cache v4: 22.48B tokens, think+RAG+codec, 4096 ctx

    Verified signature
    5ca1fa1
  5. final backup 151.28B: checkpoints/codesymb1b_pre_150B.pt

    Verified signature
    795073d
  6. final backup 151.28B: backup/state_final.tgz

    Verified signature
    0dd0548
  7. final backup 151.28B: checkpoints/pretrain_latest.pt

    Verified signature
    cf96b27
  8. Delete backup/state_20261121.tgz

    Verified signature
    915500a
  9. backup before JumpStart maintenance: checkpoints/pretrain_latest.pt

    Verified signature
    e0c1494
  10. backup before JumpStart maintenance: backup/state_20261121.tgz

    Verified signature
    8b17d29
  11. 140B milestone (formatted-data phase)

    Verified signature
    11a1c48
  12. remove root copies (moved to checkpoints/)

    Verified signature
    7d6ca40
  13. move 130.68B checkpoints into checkpoints/

    Verified signature
    efce3f3
  14. pretrain_latest.pt: 130.68B, last checkpoint before formatted-data switch

    Verified signature
    8bac49f
  15. codesymb1b_pre_130B.pt: 130.68B, last checkpoint before formatted-data switch

    Verified signature
    c6fa17c
  16. pretok_ws_clean: 189.53B never-seen tokens, ws_codec formatted, deduped vs old pool (part 7)

    Verified signature
    15f57cc
  17. pretok_ws_clean: 189.53B never-seen tokens, ws_codec formatted, deduped vs old pool (part 6)

    Verified signature
    969484a
  18. pretok_ws_clean: 189.53B never-seen tokens, ws_codec formatted, deduped vs old pool (part 5)

    Verified signature
    279eedc
  19. pretok_ws_clean: 189.53B never-seen tokens, ws_codec formatted, deduped vs old pool (part 4)

    Verified signature
    2c09982
  20. pretok_ws_clean: 189.53B never-seen tokens, ws_codec formatted, deduped vs old pool (part 3)

    Verified signature
    17deee3
  21. pretok_ws_clean: 189.53B never-seen tokens, ws_codec formatted, deduped vs old pool (part 2)

    Verified signature
    babfc0a
  22. pretok_ws_clean: 189.53B never-seen tokens, ws_codec formatted, deduped vs old pool

    Verified signature
    6105b30
  23. checkpoints/pretrain_latest.pt (MI325X run)

    Verified signature
    3fafd6d
  24. checkpoints/codesymb1b_pre_120B.pt (MI325X run)

    Verified signature
    7aed434
  25. checkpoints/codesymb1b_pre_110B.pt (MI325X run)

    Verified signature
    d3efddc

3 days ago

  1. checkpoints/pretrain_latest.pt (MI325X run)

    Verified signature
    076c7a6
  2. checkpoints/codesymb1b_pre_100B.pt (MI325X run)

    Verified signature
    a778b19
  3. checkpoints/pretrain_latest.pt (MI325X run)

    Verified signature
    9362274
  4. checkpoints/codesymb1b_pre_090B.pt (MI325X run)

    Verified signature
    1208584
  5. checkpoints/pretrain_latest.pt (MI325X run)

    Verified signature
    9e28374
  6. checkpoints/codesymb1b_pre_080B.pt (MI325X run)

    Verified signature
    e83daf3

4 days ago

  1. checkpoints/codesymb1b_pre_070B.pt (MI325X run)

    Verified signature
    20365de
  2. Upload folder using huggingface_hub

    Verified signature
    7b5e0a0
  3. checkpoints/codesymb1b_pre_060B.pt (MI325X run)

    Verified signature
    d036895
  4. checkpoints/pretrain_latest.pt (MI325X run)

    Verified signature
    2a03ad4
  5. checkpoints/codesymb1b_pre_050B.pt (MI325X run)

    Verified signature
    e8ab2d5
  6. checkpoints/pretrain_latest.pt (MI325X run)

    Verified signature
    8c5dfe7
  7. checkpoints/pretrain_latest.pt (MI325X run)

    Verified signature
    2d72a5f

5 days ago

  1. Upload checkpoints/pretrain_prev.pt with huggingface_hub

    Verified signature
    e0cbfbf
  2. Upload checkpoints/codesymb1b_pre_040B.pt with huggingface_hub

    Verified signature
    b420c9a
  3. Upload checkpoints/pretrain_latest.pt with huggingface_hub

    Verified signature
    7707aa4
  4. Upload checkpoints/pretrain_latest.pt with huggingface_hub

    Verified signature
    2dd5a65
  5. Upload checkpoints/codesymb1b_pre_030B.pt with huggingface_hub

    Verified signature
    521f85b
  6. Delete folder Pretokenized_270B with huggingface_hub

    Verified signature
    12b8d97
  7. Upload pretokenized_270B/pretokenized_270B.tar.part_aa with huggingface_hub

    Verified signature
    0db461f
  8. Upload pretokenized_270B/pretokenized_270B.tar.part_ab with huggingface_hub

    Verified signature
    910712b
  9. Upload folder using huggingface_hub (part 6)

    Verified signature
    cc522aa
  10. Upload folder using huggingface_hub (part 5)

    Verified signature
    9cd9465
  11. Upload folder using huggingface_hub (part 4)

    Verified signature
    8f4b5ed
  12. Upload folder using huggingface_hub (part 3)

    Verified signature
    f1eef4f