Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,254

Base only

Active filters: quantization

neopolita/Qwen3.6-23B-A3B-Niwaki-v2.1-2bit-mlx

Text Generation • 1.76k • Updated 19 days ago • 47

neopolita/Qwen3.6-23B-A3B-Niwaki-v2.1-4bit-gguf

Text Generation • 23B • Updated 19 days ago • 178

neopolita/Qwen3.6-23B-A3B-Niwaki-v2.1-2bit-gguf

Text Generation • 23B • Updated 19 days ago • 146

UraionLabs/MiniCPM5-2B-oQ8e

Text Generation • 3B • Updated 19 days ago • 219

UraionLabs/MiniCPM5-2B-oQ6e

Text Generation • 3B • Updated 19 days ago • 151

UraionLabs/MiniCPM5-2B-oQ5e

Text Generation • 3B • Updated 19 days ago • 157

UraionLabs/MiniCPM5-2B-oQ4e

Text Generation • 3B • Updated 19 days ago • 232 • 1

UraionLabs/MiniCPM5-2B-oQ3e

Text Generation • 3B • Updated 19 days ago • 164

UraionLabs/MiniCPM5-2B-oQ3.5e

Text Generation • 3B • Updated 19 days ago • 159

UraionLabs/MiniCPM5-2B-oQ2e

Text Generation • 3B • Updated 19 days ago • 176

UraionLabs/MiniCPM5-2B-oQ2.7e

Text Generation • 3B • Updated 19 days ago • 166

UraionLabs/MiniCPM5-2B-oQ2.5e

Text Generation • 3B • Updated 19 days ago • 213

ForeverBlue/PrismQuant-Llama-3.2-3B

Text Generation • Updated about 17 hours ago

ForeverBlue/PrismQuant-Llama-3.1-8B

Text Generation • Updated about 17 hours ago

bot-lab-21/DeepSeek-V4.1-Flash-EXL3-3.5bpw-Pollard

332B • Updated 18 days ago • 1.11k • 5

KissTheHabit/yolov8n-table-yolo

Object Detection • Updated 16 days ago

mlx-community/MiniCPM5-2B-OptiQ-4bit

Text Generation • 3B • Updated 16 days ago • 2.15k • 4

Soulfate24/PaddleOCR-VL-1.6-ASHQ1-Remix-GGUF

Image-Text-to-Text • 0.5B • Updated 19 days ago • 776

gratex/Ornith-1.5-397B-W4A16-g32-sym

Text Generation • 71B • Updated 19 days ago • 218

hoatac/gemma-4-E4B-it-AWQ

Text Generation • 8B • Updated 19 days ago • 822

hoatac/gemma-4-E4B-it-AWQ-mm

Image-Text-to-Text • 8B • Updated 19 days ago • 57

vcruz305/DSV4.1-Flash-EXL3-4.75bpw

Text Generation • 332B • Updated 7 days ago • 454 • 1

WaveCut/YuE2-3B-OrbitQuant-W4A4

Text Generation • 2B • Updated 17 days ago • 3.32k • 5

QUASAR-QAT/Muse-Glimmer-30B-QUASAR-NVFP4

Image-Text-to-Text • 30B • Updated 13 days ago • 187 • 2

QUASAR-QAT/Muse-Glimmer-30B-QUASAR-Q4_0-GGUF

Text Generation • 28B • Updated 13 days ago • 447 • 3

Shinrali/Qwen3.8-Flash-Next-NVIDIA-Hybrid-FP8-LMHead-Single-Spark

Image-Text-to-Text • 118B • Updated about 18 hours ago • 140

Gugu8/Tern-1.5

Text Generation • Updated 17 days ago • 702

vcruz305/DSV4.1-Flash-SAGE-EXL3-3.30bpw

Text Generation • 325B • Updated 8 days ago • 826 • 1

experimentalmachines/QwenGrad-Qwen3.5-2B-M1-DPO-v2-ExecuTorch-CPU

Updated 18 days ago • 10

wepiqx/NeoHorse-1-9B-MERNIK-GGUF

Text Generation • 9B • Updated 16 days ago • 3.35k • 2