Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

12,610

Base only

Active filters: quantized

empero-ai/Qwythos-9B-Claude-Mythos-5-1M-GGUF

Image-Text-to-Text • 9B • Updated 12 days ago • 1.41M • 2.47k

GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF

Text Generation • 1B • Updated 13 days ago • 179k • 166

empero-ai/Qwythos-9B-v2-GGUF

Image-Text-to-Text • 9B • Updated 15 days ago • 355k • 216

FINAL-Bench/POCKET-35B-GGUF

Text Generation • 35B • Updated about 6 hours ago • 6.55k • 44

badtheorylabs/BTL-3-Compact

Text Generation • 8B • Updated 2 days ago • 1.5k • 28

sahilchachra/Unlimited-OCR-GGUF

Image-Text-to-Text • 3B • Updated 25 days ago • 57.4k • 106

GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-Thinking-GGUF

Text Generation • 1B • Updated 13 days ago • 280k • 303

nvidia/Qwen3.6-27B-NVFP4

Text Generation • 18B • Updated 26 days ago • 1.82M • 395

InternScience/Agents-A1-4B-Q8_0-GGUF

Text Generation • 4B • Updated 12 days ago • 11.6k • 40

InternScience/Agents-A1-4B-Q4_K_M-GGUF

Text Generation • 4B • Updated 12 days ago • 13.4k • 29

nvidia/Qwen3.6-35B-A3B-NVFP4

Text Generation • 19B • Updated Jun 12 • 9.59M • 500

m15dg/local-ai-toolkit

Text Generation • 35B • Updated 8 days ago • 23.8k • 27

FINAL-Bench/POCKET-EN-GGUF

Text Generation • 23B • Updated about 6 hours ago • 1.08k • 27

Abiray/Nanbeige4.2-3B-GGUF

Text Generation • 4B • Updated 4 days ago • 4.27k • 13

Abiray/Laguna-S-2.1-IQ4_XS-Q4_K_M-GGUF

Text Generation • 84B • Updated 4 days ago • 1.37k • 12

antirez/deepseek-v4-gguf

Text Generation • 20B • Updated 10 days ago • 662k • 341

InternScience/Agents-A1-Q4_K_M-GGUF

Text Generation • 35B • Updated 11 days ago • 60.5k • 124

vcruz305/Laguna-S-2.1-GGUF

Text Generation • 118B • Updated 4 days ago • 2.36k • 10

nvidia/GLM-5.2-NVFP4

Text Generation • 381B • Updated 30 days ago • 1.63M • 283

Myric/Laguna-S-2.1-APEX-GGUF

Text Generation • 118B • Updated 1 day ago • 26.5k • 9

mlx-community/Laguna-S-2.1-oQ2e

Text Generation • 10B • Updated 3 days ago • 1.73k • 8

mudler/KAT-Coder-V2.5-Dev-APEX-GGUF

35B • Updated 1 day ago • 4.96k • 8

ewinregirgojr/MiniCPM5-1B-Agentic-Tooluse-GGUF

Text Generation • 1B • Updated about 5 hours ago • 16.6k • 68

mlx-community/Laguna-S-2.1-oQ4e

Text Generation • 17B • Updated 3 days ago • 2.89k • 7

AtomicChat/Laguna-S-2.1-GGUF

Text Generation • 118B • Updated 4 days ago • 2.85k • 7

PassingByPixels/Qwen3.6-27B-Architect-Polaris2-Fable-B-NVFP4

15B • Updated 1 day ago • 938 • 7

unsloth/Qwen-Image-Edit-2511-GGUF

Image-to-Image • 20B • Updated Jan 8 • 189k • 543

tencent/Hy3-FP8

Text Generation • 299B • Updated 6 days ago • 19.5k • 66

migtissera/Tess-4-27B-GGUF

Image-Text-to-Text • 27B • Updated 17 days ago • 27k • 32

audio-cpp/audio.cpp-gguf

Text-to-Speech • Updated about 17 hours ago • 15k • 9