Commit History

  1. Skip eval, disable MoE aux loss, disable dropout to fix OOM

    Verified signature
    9d44c0c
  2. Reduce context 4096->3072, add expandable_segments for OOM fix

    Verified signature
    bff90ea
  3. Remove max_prompt_length (not in TRL 1.9 DPOConfig)

    Verified signature
    382ee20
  4. Use DPOConfig for TRL 1.9 compatibility

    Verified signature
    6c55bf0
  5. Fix DPOTrainer: tokenizer -> processing_class (TRL 1.9)

    Verified signature
    4225e10
  6. Fix target modules: remove gate (custom MoE router)

    Verified signature
    9af44ff
  7. Add full plan doc

    Verified signature
    25e5874
  8. Genesis-2.0 RLHF Phase 0 artifacts

    Verified signature
    504e7f9
  9. DPO training script

    Verified signature
    3265eba
  10. initial commit

    Verified signature
    cb1a436