Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

10,980

Base only

Active filters: llama.cpp

JetBrains/Mellum2-12B-A2.5B-Thinking-GGUF-Q4_K_M

Text Generation • 12B • Updated Jun 4 • 2.2k • 48

jcbtc/qwopus3.6-27b-v2-chadrock-rocmfp4-mtp

Image-Text-to-Text • 27B • Updated Jun 23 • 134 • 25

yuxinlu1/gemma-4-12B-it-Claude-4.6-4.8-Opus-GGUF

Text Generation • 12B • Updated Jun 18 • 4.31k • 129

pjsmith/Qwen3.6-35B-A3B-2.6763bpw.gguf

35B • Updated Jun 7 • 594 • 9

yuxinlu1/Mellum2-12B-A2.5B-Claude-4.6-4.8-Opus-Thinking-GGUF

Text Generation • 12B • Updated Jun 9 • 910 • 41

SevenOfNine/Gemma-4-26B-A4B-It-Abliterated-GGUF

Image-Text-to-Text • 25B • Updated Jun 10 • 1.31k • 5

SupraLabs/Supra-Title-350M-exp-GGUF

Feature Extraction • 0.4B • Updated Jul 29 • 673 • 49

AlexAtomic/qwen3-coder-30b-a3b-GGUF

Text Generation • 31B • Updated Jun 18 • 1.75k • 1

Ailiance-fr/SchGen-Qwen3.6-27B-EU-GGUF

27B • Updated Jun 17 • 470 • 2

King3Djbl/mythos-9b-enhanced

Text Generation • 8B • Updated Jul 17 • 300 • 5

FunAudioLLM/SenseVoiceSmall-GGUF

Automatic Speech Recognition • 0.2B • Updated Jun 21 • 4.61k • 15

KakTakOne/Huihui-gemma-4-12B-coder-fable5-composer2.5-v1-abliterated-GGUF

Text Generation • 12B • Updated Jun 21 • 618 • 9

WaveCut/Qwen3.6-35B-A3B-REAM-160-ru-agent-GGUF-MTPLess

23B • Updated Jun 22 • 2.21k • 3

XAEA12/Huihui-gemma-4-12B-coder-fable5-composer2.5-v1-abliterated-GGUF

Text Generation • 12B • Updated Jun 23 • 575 • 2

Abiray/Huihui-Qwythos-9B-Claude-Mythos-5-1M-abliterated-GGUF

Text Generation • 9B • Updated Jun 26 • 922 • 10

KikoCis/Ornith-1.0-9B-Ollama-fixed-GGUF

9B • Updated Jul 12 • 1.2k • 10

bottlecapai/ThinkingCap-Qwen3.6-27B-GGUF

Image-Text-to-Text • 27B • Updated Aug 13 • 1.01k • 278

EntityDeletr/gpt-oss-20b-DFlash-GGUF

0.8B • Updated Jul 1 • 1.22k • 3

satgeze/Gemma4-12B-Uncensored-HauhauCS-1M-GGUF

Text Generation • 12B • Updated Jul 11 • 2.23k • 7

satgeze/Hy3-1M-GGUF

Text Generation • 295B • Updated Jul 17 • 962 • 45

ewin-reg/MiniCPM5-1B-Agentic-Tooluse-GGUF

Text Generation • 1B • Updated Jul 29 • 1.35k • 84

fableforge-ai/mythos-9b-unhinged-GGUF

Text Generation • 8B • Updated Jul 17 • 1k • 4

RemySkye/NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-GGUF

78B • Updated Jul 14 • 3.93k • 11

Gorilla4X/Bonsai-8B-Ternary-RDNA4

8B • Updated Jul 13 • 145 • 1

empero-ai/Qwythos-27B-v1-GGUF

Image-Text-to-Text • 27B • Updated Jul 29 • 305k • 71

ScottzillaSystems/gemma-4-12B-coder-fable5-composer2.5-v1-GGUF

Text Generation • 12B • Updated Jul 16 • 153 • 1

reaperdoesntknow/DualMind-TKD-Agentic-1.7B-GGUF

2B • Updated about 12 hours ago • 2.23k • 1

qvac/VisionPsy-Nano-460M-Flash-GGUFs

Image-Text-to-Text • 0.4B • Updated Jul 29 • 6.77k • 11

barozp/Qwen3.6-29B-REAP-Opus-Reasoning-Distill-MTP-GGUF

Text Generation • 29B • Updated Jul 22 • 3.24k • 11

barozp/Qwen3.6-29B-REAP-Opus-Reasoning-Distill-GGUF

Text Generation • 28B • Updated Jul 22 • 2.49k • 2