Skip eval, disable MoE aux loss, disable dropout to fix OOM 9d44c0c verified jacobeen06 commited on 8 days ago
Reduce context 4096->3072, add expandable_segments for OOM fix bff90ea verified jacobeen06 commited on 8 days ago
Remove max_prompt_length (not in TRL 1.9 DPOConfig) 382ee20 verified jacobeen06 commited on 8 days ago
Fix DPOTrainer: tokenizer -> processing_class (TRL 1.9) 4225e10 verified jacobeen06 commited on 8 days ago
Fix target modules: remove gate (custom MoE router) 9af44ff verified jacobeen06 commited on 8 days ago