DPO for Multiple-Choice Reasoning nevertmr/mistral-7b-qlora-dpo Text Generation • 7B • Updated Jul 16 • 18
SO-101 cup → blue circle One instruction for the whole motion. White paper cup, 70 solo episodes + the pi05 fine-tunes trained on them. nevertmr/so101_cup_bluecircle_1task SO-101 • Updated Jul 22 • 50 episodes • 173 • 1 nevertmr/so101_cup_bluecircle_1task_var SO-101 • Updated Jul 22 • 20 episodes • 118 • 1 aailabkaist/pi05_coffee_NorRec_RW_10k Robotics • 4B • Updated Aug 1 • 32 nevertmr/so101_cup_bluecircle_2task SO-101 • Updated Jul 22 • 113 episodes • 145
DPO for Multiple-Choice Reasoning nevertmr/mistral-7b-qlora-dpo Text Generation • 7B • Updated Jul 16 • 18
SO-101 cup → blue circle One instruction for the whole motion. White paper cup, 70 solo episodes + the pi05 fine-tunes trained on them. nevertmr/so101_cup_bluecircle_1task SO-101 • Updated Jul 22 • 50 episodes • 173 • 1 nevertmr/so101_cup_bluecircle_1task_var SO-101 • Updated Jul 22 • 20 episodes • 118 • 1 aailabkaist/pi05_coffee_NorRec_RW_10k Robotics • 4B • Updated Aug 1 • 32 nevertmr/so101_cup_bluecircle_2task SO-101 • Updated Jul 22 • 113 episodes • 145