Self-Fulfilling (Mis)alignment: Post-Trained Models
Collection
Here is a selection of models that have undergone DPO. We also share the earlier instruction checkpoints. We recommend using the DPO models. • 22 items • Updated • 2
Boyd Kane
beyarkay
AI & ML interests
None yet
Recent Activity
new activity 13 days ago
beyarkay/slash-bad:Add 1 slash-bad case(s) updated a dataset 13 days ago
beyarkay/slash-bad published a dataset 13 days ago
beyarkay/slash-badOrganizations
None yet
upvoted a collection 7 months ago