sfulay/kto-aligned-model-lora
Updated • 6
Edit Models filters
Showing models from
Tasks
Parameters
Inference Providers
Hardware
Models
66
Active filters: sfulay
sfulay/zephyr-7b-dpo-full
Text Generation • 7B • Updated • 20
sfulay/zephyr-7b-dpo-full-ultrabin-2
Text Generation • 7B • Updated • 14
sfulay/zephyr-7b-dpo-full-hh
Text Generation • 7B • Updated • 9
sfulay/zephyr-7b-sft-full-amazon
Text Generation • Updated • 15
sfulay/zephyr-7b-dpo-full-ultrabin-grad
Updated
sfulay/zephyr-7b-dpo-full-ultrabin-high-margin
7B • Updated • 10
sfulay/zephyr-7b-dpo-full-ultrabin-reward-scale-1
7B • Updated • 13
sfulay/zephyr-7b-dpo-full-ultrabin-low-margin
7B • Updated • 6
sfulay/zephyr-7b-dpo-full-ultrabin-reward-scale-01
7B • Updated • 18
sfulay/zephyr-7b-dpo-full-ultrabin-reward-scale-05
7B • Updated • 6
sfulay/zephyr-7b-dpo-full-ultrabin-high-curriculum
7B • Updated • 5
sfulay/zephyr-7b-dpo-full-ultrabin-low-curriculum
7B • Updated • 4
sfulay/zephyr-7b-dpo-full-ultrabin-amazon
Updated • 8
sfulay/zephyr-7b-dpo-full-ultrabin-high-bleu
7B • Updated • 8
sfulay/zephyr-7b-dpo-full-ultrabin-low-bleu
7B • Updated • 3
sfulay/zephyr-7b-dpo-full-ultrabin-high-margin-3-epochs
7B • Updated • 5
sfulay/zephyr-7b-dpo-full-ultrabin-low-margin-3-epochs
7B • Updated • 8
sfulay/zephyr-7b-dpo-full-ultrabin-low-bleu-3-epochs
7B • Updated • 7
sfulay/zephyr-7b-dpo-full-magpi-3
7B • Updated • 8
sfulay/zephyr-7b-dpo-full-magpi-high-curriculum
7B • Updated • 10
sfulay/zephyr-7b-dpo-full-magpi-high-bleu-3-epochs
7B • Updated • 5
sfulay/zephyr-7b-dpo-full-ultrabin-high-bleu-3-epochs
7B • Updated • 4
sfulay/zephyr-7b-dpo-full-ultrabin-reward-scale-01-random
7B • Updated • 10
sfulay/zephyr-7b-dpo-full-magpi-high-margin-3-epochs
7B • Updated • 3
sfulay/zephyr-7b-dpo-full-magpi-low-bleu-3-epochs
7B • Updated • 4
sfulay/zephyr-7b-dpo-full-magpi-low-curriculum
7B • Updated • 11
sfulay/zephyr-7b-dpo-full-magpi-low-margin-3-epochs
7B • Updated • 6
sfulay/zephyr-7b-dpo-full-magpi-reward-scale-1
7B • Updated • 9
sfulay/zephyr-7b-dpo-full-magpi-reward-scale-01
7B • Updated • 7