DPO datasets
updated
Viewer • Updated • 7.5k • 706
• 184
argilla/distilabel-capybara-dpo-7k-binarized
Viewer • Updated • 7.56k • 7.13k
• 193
llamafactory/DPO-En-Zh-20k
Viewer • Updated • 20k • 440
• 106
argilla/distilabel-intel-orca-dpo-pairs
Viewer • Updated • 12.9k • 8.13k
• 188
argilla/ultrafeedback-binarized-preferences-cleaned
Viewer • Updated • 60.9k • 10.5k
• 176
argilla/distilabel-math-preference-dpo
Viewer • Updated • 2.42k • 288
• 88
M4-ai/prm_dpo_pairs_cleaned
Viewer • Updated • 7.99k • 58
• 11
jondurbin/truthy-dpo-v0.1
Viewer • Updated • 1.02k • 728
• 142
YeungNLP/ultrafeedback_binarized
Viewer • Updated • 63.1k • 25
• 1
shibing624/DPO-En-Zh-20k-Preference
Viewer • Updated • 20k • 159
• 18
Preview • Updated • 60
• 6
mlabonne/orpo-dpo-mix-40k
Viewer • Updated • 44.2k • 720
• 318
Viewer • Updated • 15.3k • 118
• 20
jondurbin/gutenberg-dpo-v0.1
Viewer • Updated • 918 • 868
• 176
CyberNative/Code_Vulnerability_Security_DPO
Viewer • Updated • 4.66k • 2.28k
• 191
mlabonne/orpo-dpo-mix-40k-flat
Viewer • Updated • 44.2k • 49
• 17
selimc/orpo-dpo-mix-TR-20k
Viewer • Updated • 19.9k • 95
• 7
efederici/alpaca-vs-alpaca-orpo-dpo
Viewer • Updated • 49.2k • 144
• 7
Viewer • Updated • 2.42k • 36
• 10
allenai/llama-3.1-tulu-3-8b-preference-mixture
Viewer • Updated • 273k • 4.49k
• 28
allenai/llama-3.1-tulu-3-70b-preference-mixture
Viewer • Updated • 337k • 311
• 19
HuggingFaceH4/ultrafeedback_binarized
Viewer • Updated • 187k • 35k
• 363
Viewer • Updated • 83.1k • 2.66k
• 227
allenai/llama-3.1-tulu-3-405b-preference-mixture
Viewer • Updated • 361k • 183
• 7
Viewer • Updated • 450k • 147k
• 823
qihoo360/Light-R1-DPOData
Viewer • Updated • 2.97k • 600
• 29