Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

13,522

Base only

Active filters: quantized

OptimizeLLM/Qwen3.5-122B-A10B-heretic-MTP-NVFP4

Text Generation • 74B • Updated Apr 11 • 5.34k • 9

pbhappliedsystems/qwen-2.5-14B-instruct-1m-gguf-Q4-K-M

15B • Updated May 5 • 676 • 3

majentik/Qwen3.5-27B-RotorQuant-MLX-4bit

Text Generation • 27B • Updated 18 days ago • 249 • 1

scottgl/Qwen3.5-122B-A10B-NVFP4-GB10

Text Generation • 27B • Updated Apr 16 • 1.06k • 6

gdubicki/Qwen3-Coder-Next-NVFP4-GB10

Text Generation • Updated Apr 17 • 176k • 3

majentik/Qwen3.6-35B-A3B-RotorQuant-MLX-2bit

Text Generation • 4B • Updated 18 days ago • 2.03k • 9

majentik/Qwen3.6-35B-A3B-TurboQuant-MLX-2bit

Text Generation • 4B • Updated 18 days ago • 1.02k • 4

Xartorx/gemma-4-E4B-it-heretic-oQ8

2B • Updated Apr 17 • 30 • 1

Trillim/Bonsai-4BT-TRNQ

Text Generation • Updated Apr 17 • 9 • 1

notanoption1/Qwen3.6-35B-A3B-Q4_K_M-GGUF

35B • Updated Apr 18 • 203 • 1

Outlier-Ai/DeepSeek-R1-Distill-Qwen-14B-MLX-4bit

Text Generation • 15B • Updated May 5 • 451 • 1

cloudbjorn/Qwen3.6-35B-A3B_Opus-4.6-Reasoning-3300x-GGUF

Text Generation • 35B • Updated Apr 21 • 152 • 2

lyf/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-NVFP4

Image-Text-to-Text • 21B • Updated Jun 13 • 21.8k • 13

mudler/Qwen3.6-35B-A3B-uncensored-heretic-APEX-GGUF

35B • Updated Apr 27 • 25.1k • 69

TheHouseOfTheDude/Qwen3.6-27B-INT8

Image-Text-to-Text • 28B • Updated Jun 1 • 16.3k • 10

mudler/MiniMax-M2.7-APEX-GGUF

229B • Updated Apr 27 • 1.84k • 14

sgl-project/DeepSeek-V4-Pro-FP8

1.6T • Updated Apr 24 • 4.28k • 13

Thump604/DeepSeek-V4-Flash-MLX-Q3-mixed-gs128-affine

Text Generation • 284B • Updated Apr 24 • 533 • 4

Brooooooklyn/Qwen3.6-27B-UD-Q8_K_XL-mlx

Text Generation • 9B • Updated May 15 • 343 • 7

kai-os/Carnice-V2-27b-GGUF

27B • Updated Apr 25 • 20.9k • 109

btbtyler09/Qwen3.6-27B-GPTQ-8bit

Image-Text-to-Text • 28B • Updated Apr 26 • 68.8k • 3

ggml-org/Qwen3.5-0.8B-GGUF

Image-Text-to-Text • 0.8B • Updated 22 days ago • 7.45k • 7

mudler/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-APEX-GGUF

32B • Updated Apr 29 • 9k • 12

batiai/DeepSeek-V4-Flash-GGUF

Text Generation • 284B • Updated May 3 • 1.29k • 12

ddndm/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-APEX-GGUF

35B • Updated May 5 • 196 • 5

Lucebox/Laguna-XS.2-GGUF

33B • Updated May 8 • 254 • 17

AtomicChat/gemma-4-E2B-it-assistant-GGUF

Text Generation • 77.2M • Updated 15 days ago • 1.19k • 8

AtomicChat/gemma-4-E4B-it-assistant-GGUF

Text Generation • 78M • Updated 15 days ago • 2.18k • 23

AtomicChat/gemma-4-31B-it-assistant-GGUF

Text Generation • 0.5B • Updated 15 days ago • 1.78k • 17

jkim96/Qwen3.6-27B-DASHQ-INT3-g32

Text Generation • 3B • Updated about 5 hours ago • 8 • 1