Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

18,152

Base only

Active filters: quantized

sinimiini/HRM-Text-1B-GGUF

Text Generation • 1B • Updated May 21 • 312 • 22

stepfun-ai/Step-3.7-Flash-GGUF

Image-Text-to-Text • 197B • Updated Jun 3 • 4.38k • 174

RootMonsteR/Qwen3-14B-Abliterated-GGUF

Text Generation • 15B • Updated May 31 • 10.6k • 5

AlicanKiraz0/Titus-CybersecurityLLM-v1.0-Q4_K_M-No-MTP-GGUF

Text Generation • 35B • Updated Jun 1 • 497 • 39

LeaderboardModel1/Qwen3.5-27B-Writer-V2-AutoRound-W4A16-RTN

Text Generation • 3B • Updated Jun 2 • 58 • 4

AEON-7/Gemma-4-12B-it-AEON-Abliterated-MLX-8bit

Image-Text-to-Text • 12B • Updated Jun 21 • 7.88k • 5

mlx-community/gemma-4-12B-it-OptiQ-4bit

Text Generation • 12B • Updated Jul 20 • 3.33k • 55

SC117/gemma-4-12B-it-heretic-QAT-GGUF

12B • Updated 2 days ago • 10.6k • 54

GulfCoastAI/Mistral-Small-4-119B-Heretic-NVFP4

68B • Updated Jun 9 • 177 • 5

empero-ai/Qwable-9B-Claude-Fable-5-GGUF

Image-Text-to-Text • 9B • Updated Jun 19 • 10.7k • 85

r0b0tlab/FastContext-1.0-4B-RL-NVFP4

Text Generation • 2B • Updated Jun 16 • 130 • 2

AlexAtomic/qwen3-coder-30b-a3b-GGUF

Text Generation • 31B • Updated Jun 18 • 1.74k • 1

sahilchachra/Qwen3.6-35B-A3B-uncensored-heretic-AWQ

Text Generation • 35B • Updated Jun 19 • 1.01k • 2

sahilchachra/Unlimited-OCR-GGUF

Image-Text-to-Text • 3B • Updated Jul 1 • 8.49k • 147

DhruvalLabs/Qwen-AgentWorld-35B-A3B-GGUF

Image-Text-to-Text • 35B • Updated Jun 24 • 1.81k • 6

avlp12/Krea-2-Turbo-Alis-MLX-mixed-4-8

Text-to-Image • Updated Jul 14 • 160 • 5

Sebesky/MiniMax-M3-W4A16-GPTQ

Image-Text-to-Text • 430B • Updated Jun 26 • 169 • 4

Winnougan/Z-Image-Base-Turbo-INT8-Convrot

Text-to-Image • Updated Jul 2 • 25

InternScience/Agents-A1-FP8

Text Generation • 35B • Updated Jul 15 • 408 • 24

InternScience/Agents-A1-Q4_K_M-GGUF

Text Generation • 35B • Updated Jul 15 • 9.56k • 149

LAXMAYDAY/LTX-2.3-22b-dev-int8-tensorwise

Updated Jul 3 • 3

GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-Thinking-GGUF

Text Generation • 1B • Updated Jul 13 • 261k • 331

Winnougan/Qwen-3.5-INT8-Convrot-Comfy

Updated Jul 4 • 19

NoemaAI-labs/Noema-2B-GGUF

Text Generation • 2B • Updated Jul 9 • 1.38k • 5

erectbranch/sam3-gguf

Mask Generation • 0.9B • Updated Jul 7 • 109 • 3

supermind/int8_convrot_models

Updated Jul 25 • 24

RemySkye/NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-GGUF

78B • Updated Jul 14 • 3.3k • 11

YoozLabs/Qwen3.5-0.8B-qat-GGUF

Text Generation • 0.8B • Updated Jul 13 • 168 • 1

YoozLabs/Qwen3.5-4B-qat-GGUF

Text Generation • 4B • Updated Jul 13 • 224 • 2

InternScience/Agents-A1-4B-Q8_0-GGUF

Text Generation • 4B • Updated Jul 14 • 230k • 48