LLM course HW2: DPO, Reward Model, PPO Collection SmolLM-135M-Instruct aligned on HumanLLMs/Human-Like-DPO-Dataset: DPO from scratch, reward model and PPO with TRL. • 3 items • Updated 7 days ago