Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

preference-optimization

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

211

Base only

Active filters: preference-optimization

promotion/Llama-3.1-8B-Panacea-baseline

Text Generation • 8B • Updated 26 days ago • 336

promotion/Llama-3.1-8B-NBPO-finitepool

Text Generation • 8B • Updated 24 days ago • 822

promotion/Llama-3.1-8B-FixedReferenceNBPO

Text Generation • 8B • Updated 26 days ago • 305

promotion/Llama-3.1-8B-TLDR-MaxMinRLHF-baseline

Text Generation • 8B • Updated 26 days ago • 566

promotion/Llama-3.1-8B-TLDR-RewardedSoups-baseline

Text Generation • 8B • Updated 26 days ago • 341

promotion/Llama-3.1-8B-TLDR-Panacea-baseline

Text Generation • 8B • Updated 26 days ago • 345

promotion/Llama-3.1-8B-TLDR-NBPO-finitepool

Text Generation • 8B • Updated 26 days ago • 342

promotion/Llama-3.1-8B-TLDR-Utilitarian-baseline

Text Generation • 8B • Updated 26 days ago • 300

promotion/Llama-3.1-8B-TLDR-AbsoluteMaxMin-baseline

Text Generation • 8B • Updated 26 days ago • 283

promotion/Llama-3.1-8B-TLDR-SurplusMaxMin-baseline

Text Generation • 8B • Updated 26 days ago • 284

promotion/Llama-3.1-8B-SafeRLHF-MaxMinRLHF-baseline

Text Generation • 8B • Updated 26 days ago • 295

promotion/Llama-3.1-8B-SafeRLHF-RewardedSoups-baseline

Text Generation • 8B • Updated 26 days ago • 343

promotion/Llama-3.1-8B-SafeRLHF-NBPO-finitepool

Text Generation • 8B • Updated 26 days ago • 361

promotion/Llama-3.1-8B-SafeRLHF-Utilitarian-baseline

Text Generation • 8B • Updated 26 days ago • 365

promotion/Llama-3.1-8B-SafeRLHF-AbsoluteMaxMin-baseline

Text Generation • 8B • Updated 26 days ago • 348

promotion/Llama-3.1-8B-SafeRLHF-SurplusMaxMin-baseline

Text Generation • 8B • Updated 26 days ago • 353

promotion/Llama-3.1-8B-NBPO-UltraFeedback-clean

Text Generation • 8B • Updated 24 days ago • 290

promotion/Llama-3.1-8B-NBPO-UltraFeedback-eta0.05

Text Generation • 8B • Updated 24 days ago • 289

promotion/Llama-3.1-8B-TLDR-NBPO-eta0.05

Text Generation • 8B • Updated 24 days ago • 282

promotion/Llama-3.1-8B-SafeRLHF-NBPO-eta0.1

Text Generation • 8B • Updated 24 days ago • 285

promotion/Qwen3-8B-MaxMinRLHF-baseline

Text Generation • 8B • Updated 24 days ago • 268

promotion/Qwen3-8B-RewardedSoups-baseline

Text Generation • 8B • Updated 24 days ago • 284

promotion/Qwen3-8B-Panacea-baseline

Text Generation • 8B • Updated 24 days ago • 287

promotion/Llama-3.1-8B-SafeRLHF-NBPO-stage2

Text Generation • 8B • Updated 24 days ago • 349

promotion/Llama-3.1-8B-NBPO-UltraFeedback-600updates

Text Generation • 8B • Updated 24 days ago • 359

promotion/Llama-3.1-8B-TLDR-NBPO-600updates

Text Generation • 8B • Updated 24 days ago • 348

promotion/Llama-3.1-8B-SafeRLHF-NBPO-600updates

Text Generation • 8B • Updated 24 days ago • 363

promotion/nbpo-policy-diagnostics

Updated 23 days ago

arjhinety/OpenGrad-Qwen3.5-2B-M1-DPO

Updated 18 days ago

promotion/NBPO-Qwen2.5-7B-WildChecklists-2ep

Text Generation • 8B • Updated 15 days ago • 435