OpenMythos / training

Commit History

  1. fix training

    Kye Gomez
    eae0f04
  2. [improvement][loguru-logging][replace print with loguru in training script][feat][ckpt-logging][add checkpoint start and success log events][docs][readme-optimizer][remove muon optimizer⁠

    Kye Gomez
    7ba6907
  3. [fix][rope Every decode token was stuck at position 0, so <q_decoded, k_cached> lost the (n - m) term entirely]

    Kye Gomez
    18cca89
  4. just use adam for now in training maybe add muon later

    Kye Gomez
    537b116
  5. [feat][training-script][add 3b fineweb-edu training⁠

    Kye Gomez
    5ffb897