Commit History
-
Skip eval, disable MoE aux loss, disable dropout to fix OOM
Verified signature9d44c0c -
Reduce context 4096->3072, add expandable_segments for OOM fix
Verified signaturebff90ea -
Remove max_prompt_length (not in TRL 1.9 DPOConfig)
Verified signature382ee20 -
Use DPOConfig for TRL 1.9 compatibility
Verified signature6c55bf0 -
Fix DPOTrainer: tokenizer -> processing_class (TRL 1.9)
Verified signature4225e10 -
Fix target modules: remove gate (custom MoE router)
Verified signature9af44ff -
Add full plan doc
Verified signature25e5874 -
Genesis-2.0 RLHF Phase 0 artifacts
Verified signature504e7f9 -
DPO training script
Verified signature3265eba -
initial commit
Verified signaturecb1a436