Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

preference-optimization

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

147

Base only

Active filters: preference-optimization

promotion/qwen3-8b-aaai27-p3-ronpo-alpha050_anchor0035_lr7p5e8-s42

Text Generation • 8B • Updated 19 days ago • 419

promotion/ronpo-qwen3-8b-fair-dpo-s42

Text Generation • 8B • Updated 18 days ago • 151

promotion/ronpo-qwen3-8b-fair-ht-mnpo-helpfulness-s42

Text Generation • 8B • Updated 18 days ago • 167

promotion/ronpo-qwen3-8b-fair-ht-mnpo-safety-s42

Text Generation • 8B • Updated 18 days ago • 203

promotion/ronpo-qwen3-8b-fair-inpo-avg-s42

Text Generation • 8B • Updated 18 days ago • 167

promotion/ronpo-qwen3-8b-fair-ronpo-full-expect-s42

Text Generation • 8B • Updated 18 days ago • 193

promotion/ronpo-qwen3-8b-fair-ronpo-k-only-s42

Text Generation • 8B • Updated 18 days ago • 225

promotion/ronpo-qwen3-8b-fair-sppo-avg-s42

Text Generation • 8B • Updated 18 days ago • 233

thesreedath/slm-125m-dpo

0.1B • Updated 18 days ago • 17

thesreedath/slm-500m-dpo

0.5B • Updated 18 days ago • 21

thesreedath/slm-125m-dpo2

0.1B • Updated 16 days ago • 23

thesreedath/slm-500m-dpo2

0.5B • Updated 16 days ago • 19

thesreedath/slm-gemma-2b-dpo2

3B • Updated 16 days ago • 19

promotion/ronpo-llama31-saferlhf-p5-topmass-stage1-s42

8B • Updated 16 days ago • 45

promotion/ronpo-llama31-saferlhf-stage3-os-s42

Text Generation • 8B • Updated 16 days ago • 260

ayushshah/Qwen3-1.7B-Chat-LoRA

Text Generation • Updated 15 days ago • 48

ayushshah/Qwen3-1.7B-Chat

Text Generation • 2B • Updated 15 days ago • 537

promotion/ronpo-llama31-saferlhf-stage4-os-s42

Text Generation • 8B • Updated 15 days ago • 38

ayushshah/Qwen3-1.7B-Chat-GGUF

Text Generation • 2B • Updated 13 days ago • 442

Lixiaojian123/qwen3-0.6b-dpo

Text Generation • 0.6B • Updated 12 days ago • 27

sngwon/Qwen3-8B-usersim-dpo

Text Generation • 8B • Updated 10 days ago • 22

submarat/gpt2-small-fineweb-edu-10b-dpo

Text Generation • 0.1B • Updated 9 days ago • 38

sngwon/Qwen3-8B-usersim-online-dpo

Text Generation • 8B • Updated 9 days ago • 30

promotion/ronpo-maxmin-saferlhf-llama31-stage4-s42

Text Generation • 8B • Updated 9 days ago • 48

promotion/ronpo-maxmin-saferlhf-llama31-stage4-s43

Text Generation • 8B • Updated 9 days ago • 41

promotion/ronpo-maxmin-saferlhf-llama31-stage4-s44

Text Generation • 8B • Updated 9 days ago • 44

sarimahsan101/Qwen2.5-0.5B-DPO-detox

0.5B • Updated 8 days ago • 21