Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

10,975

Base only

Active filters: llama.cpp

jc-builds/Qwen3.5-9B-VLM-Q4_K_M-GGUF

Image-Text-to-Text • 9B • Updated Mar 18 • 6.83k • 14

psin23/vercel-doc-mistral

7B • Updated Mar 21 • 25 • 1

matrixdose/Mistral-Nemo-2407-12B-Thinking-Claude-Gemini-GPT5.2-Uncensored-HERETIC-GGUF

Text Generation • 12B • Updated Mar 30 • 172 • 2

EchoLabs33/Zamba2-7B-Instruct-v2-GGUF

Text Generation • 11B • Updated Apr 14 • 77 • 2

Ex0bit/Gemma4-PRISM-PRO-DQ

Image-Text-to-Text • 31B • Updated Apr 8 • 4 • 32

Jackrong/Gemopus-4-26B-A4B-it-GGUF

Image-Text-to-Text • 25B • Updated Jul 9 • 1.29k • 108

groxaxo/Huihui-gemma-4-26B-A4B-it-abliterated-GGUF

Image-Text-to-Text • 25B • Updated Aug 22 • 26.6k • 36

hesamation/Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

Text Generation • 35B • Updated Apr 19 • 136k • 293

wangzhang/Qwen3.6-27B-abliterated-GGUF

Text Generation • 27B • Updated Aug 29 • 1.16k • 10

nsparks/DeepSeek-V4-Flash-FP4-FP8-GGUF

284B • Updated Apr 26 • 2.73k • 16

groxaxo/Qwen3.6-27B-abliterated-v2-UD-GGUF

27B • Updated Aug 22 • 384 • 3

fesalfayed/gpt-oss-20b-hermes_agent-tool-finetune_gguf

Text Generation • 21B • Updated May 2 • 1.96k • 6

ssweens/DeepSeek-V4-Flash-GGUF-YMMV

Text Generation • 284B • Updated May 12 • 269 • 9

cyberneurova/CyberNeurova-DeepSeek-V4-Flash-abliterated-GGUF

Text Generation • 284B • Updated May 6 • 4.15k • 62

AtomicChat/gemma-4-26B-A4B-it-assistant-GGUF

Text Generation • 0.4B • Updated Jul 23 • 2.66k • 32

teamblobfish/DeepSeek-V4-Flash-GGUF

Text Generation • 284B • Updated May 19 • 1.06k • 29

sana0756/Gemma-4-GodMode-V9-Ultimate-GGUF

8B • Updated May 9 • 182 • 4

AtomicChat/Qwen3.6-35B-A3B-UDT-MTP-GGUF

Image-Text-to-Text • 0.4B • Updated Jul 22 • 5.98k • 13

lemuralabs/Qwen3.6-27B-V2-abliterated-uncensored-TQ3_4s-GGUF

Image-Text-to-Text • 27B • Updated Aug 5 • 115 • 3

lemuralabs/Qwen3.6-27B-V2-abliterated-uncensored-Q4_K_M-GGUF

Image-Text-to-Text • 27B • Updated Aug 5 • 8.47k • 3

Abiray/MiniCPM5-1B-GGUF

Text Generation • 1B • Updated May 28 • 996 • 46

huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated Jun 6 • 203k • 144

Jackrong/Qwopus3.5-4B-Coder-MTP-GGUF

Image-Text-to-Text • 0.3B • Updated May 30 • 5.2k • 64

stepfun-ai/Step-3.7-Flash-GGUF

Image-Text-to-Text • 197B • Updated Jun 3 • 4.61k • 174

redhamohamed/mimo-v5-gguf

Text Generation • 8B • Updated May 29 • 111 • 1

tvall43/Qwen3.6-14B-A3B-VibeForged-v2-GGUF

Text Generation • 14B • Updated May 29 • 3.67k • 36

poolside-laguna-hackathon/Piscina-XS.2-GGUF

Text Generation • 33B • Updated May 30 • 653 • 11

AlicanKiraz0/Titus-CybersecurityLLM-v1.0-Q4_K_M-No-MTP-GGUF

Text Generation • 35B • Updated Jun 1 • 499 • 39

raicoon2k/Qwen3.5-9B-MTP-SWE-Agent-GGUF

Image-Text-to-Text • 0.5B • Updated Jun 3 • 751 • 4

JetBrains/Mellum2-12B-A2.5B-Thinking-GGUF-Q4_K_M

Text Generation • 12B • Updated Jun 4 • 2.2k • 48