Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32

Base only

Active filters: iq4_nl

vmlinux/Qwen3.8-Flash-Next-Uncensored-Gufo-Q4Mix-GGUF

Image-Text-to-Text • 177B • Updated 6 days ago • 41.3k • 7

Solstice-AI/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-GGUF-UltraOptimised-DSpark-MTP

Image-Text-to-Text • 27B • Updated 28 days ago • 13.6k • 14

kataguru/Qwen3.8-27B-Titan-v3.2-GGUF

Text Generation • 27B • Updated 1 day ago • 1.48k • 2

ebircak/gemma-4-31B-it-GGUF

Text Generation • 31B • Updated Apr 9 • 139 • 2

jackasda211233/Gemma-4-E4B-Deckard-AttnQ8-IQ4_NL-storyMaker

8B • Updated Apr 29 • 108 • 3

andreribeiro87/telco-troubleshooting-agentic-challenge-gguf

Text Generation • 35B • Updated May 3 • 53

jorge-erdb/GLM-4.7-Flash-D-IQ4NL-GGUF

Text Generation • 30B • Updated May 5 • 35

jackasda211233/Qwen3.6-27B-AEON-RYS-SignalLatch-GGUF

29B • Updated Jun 30 • 518 • 3

Nic22Of2003/Qwen3.5-2B-Uncensored-HauhauCS-Aggressive-IQ4_NL

Text Generation • 2B • Updated May 10 • 961 • 3

jairo/Llama-3.1-70B-LatamGPT-SFT-1.0-GGUF

Text Generation • 71B • Updated Jun 7 • 313 • 1

djdeniro/MiniMax-M2.7-MXFP416

Text Generation • 130B • Updated Jun 9 • 67

h4rm0n1c/qwen3.5-24b-a10b-IQ4_NL-GGUF

24B • Updated Jun 19 • 207 • 1

h4rm0n1c/qwen3.5-24b-a3b-reap-0.32-iq4_nl-GGUF

24B • Updated Jun 19 • 48

Deviad/GLM-5.2-mixed-IQ2S-experts-IQ4NL-rest

754B • Updated Jun 21 • 62 • 1

Deviad/GLM-5.2-shortgpt-pruned-IQ2S-experts-IQ4NL-rest

625B • Updated Jun 21 • 33 • 1

FadedRedStar/Anubis-Mini-8B-v1-heretic-imatrix-GGUF

Text Generation • 8B • Updated Jul 10 • 410 • 1

FadedRedStar/LFM2.5-8B-A1B-heretic-imatrix-GGUF

Text Generation • 8B • Updated Jul 10 • 178 • 1

FadedRedStar/Qwen3.5-9B-heretic-imatrix-GGUF

Image-Text-to-Text • 0.5B • Updated Jul 10 • 2.6k • 1

FadedRedStar/Ministral-3-8B-Reasoning-2512-heretic-imatrix-GGUF

Image-Text-to-Text • 8B • Updated Jul 10 • 233 • 2

FadedRedStar/QwenPaw-Flash-9B-heretic-imatrix-GGUF

Image-Text-to-Text • 0.5B • Updated Jul 10 • 429 • 1

jackasda211233/Qwen3.6-27B-AEON-RYS-Agentic-Coder-PatchCode-GGUF

29B • Updated Jul 25 • 410

FadedRedStar/LFM2.5-350M-heretic-imatrix-GGUF

Text Generation • 0.4B • Updated Jul 10 • 107

FadedRedStar/LFM2.5-VL-450M-heretic-imatrix-GGUF

Image-Text-to-Text • 0.4B • Updated Jul 10 • 205

FadedRedStar/LFM2.5-VL-1.6B-heretic-imatrix-GGUF

Image-Text-to-Text • 1B • Updated Jul 10 • 115 • 2

FadedRedStar/Qwen3.5-0.8B-heretic-imatrix-GGUF

Image-Text-to-Text • 0.1B • Updated Jul 10 • 751 • 1

FadedRedStar/Qwen3.5-2B-heretic-imatrix-GGUF

Image-Text-to-Text • 0.3B • Updated Jul 10 • 512 • 1

FadedRedStar/Qwen3.5-4B-heretic-imatrix-GGUF

Image-Text-to-Text • 0.3B • Updated Jul 10 • 779 • 1

jackasda211233/Agents-A1-IQ4_NL

Text Generation • 35B • Updated Jul 6 • 50 • 1

Naypa/OpenThai-2.0-Legal-ThaiLLM-Nemotron-3-Nano-30B-A3B-IQ4_NL-GGUF

Text Generation • 32B • Updated Jul 25 • 47 • 1

Koshkasa/Vortex5_Phoenix-X-26B-A4B-IQ4_NL-GGUF

Text Generation • 14.2M • Updated Aug 13 • 90