tinynext / v2

Commit History

Today

  1. link the new paperweight home and default train.py to it

    cfahlgren1 HF Staff
    Verified signature
    6f8d8d2
  2. remove the 3b-token experiment folder, now the same as v2

    cfahlgren1 HF Staff
    Verified signature
    3f7cc27

Yesterday

  1. make the 3b-token run v2 and add the size comparison

    cfahlgren1 HF Staff
    Verified signature
    a739c7e
  2. tinynext-v2-3b: 12.5M params, 56 min on GPU

    cfahlgren1 HF Staff
    Verified signature
    dc714b2
  3. export the compressed browser format from train.py instead of int8 activations

    cfahlgren1 HF Staff
    Verified signature
    4dece7f
  4. tinynext-v2-nofim: 12.5M params, 28 min on GPU

    cfahlgren1 HF Staff
    Verified signature
    e5dde63
  5. fetch the shared eval from v2/ even when uploading to an experiment folder

    cfahlgren1 HF Staff
    Verified signature
    0de7556
  6. v2: 13 MB browser build (int8 download, float compute), export/compress scripts, onnx evals

    cfahlgren1 HF Staff
    Verified signature
    33bfb6d
  7. no-FIM models are evaluated with prefix-only prompts

    cfahlgren1 HF Staff
    Verified signature
    793c5c9
  8. tinynext-v2: 12.5M params, 28 min on GPU

    cfahlgren1 HF Staff
    Verified signature
    1cffd47
  9. prepare data on a CPU job, train from the prepared files

    cfahlgren1 HF Staff
    Verified signature
    63b64fd
  10. parallel data prep, data on GPU, trackio, safetensors

    cfahlgren1 HF Staff
    Verified signature
    9bba47b
  11. fix step count

    cfahlgren1 HF Staff
    Verified signature
    88610cb
  12. v2: training script, eval harness, eval set and baseline metrics

    cfahlgren1 HF Staff
    Verified signature
    3f86878