Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,946

Base only

Active filters: llama.cpp

empero-ai/Qwythos-9B-v2-GGUF

Image-Text-to-Text • 9B • Updated 24 days ago • 488k • 234

Hikari07jp/Ternary-Bonsai-27B-Abliterated-LowDeg-GGUF

Text Generation • 27B • Updated 14 days ago • 9.68k • 23

FINAL-Bench/POCKET-35B-GGUF

Text Generation • 35B • Updated 6 days ago • 86.1k • 64

LiquidAI/LFM2.5-Audio-1.5B-JP-GGUF

Audio-to-Audio • 1B • Updated Jun 7 • 2.21k • 29

LiquidAI/LFM2.5-230M-GGUF

Text Generation • 0.2B • Updated Jun 24 • 24.4k • 78

sahilchachra/Unlimited-OCR-GGUF

Image-Text-to-Text • 3B • Updated Jul 1 • 42.1k • 116

GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF

Text Generation • 1B • Updated 22 days ago • 261k • 181

badtheorylabs/BTL-3-Compact

Text Generation • 8B • Updated 12 days ago • 2.47k • 37

andyoneal/Plainspeak-Dial-Gemma-4-26B-A4B

81.7k • Updated 12 days ago • 53 • 10

t-tech/T-Search-GGUF

Text Generation • 36B • Updated 7 days ago • 438 • 6

FrontisAI/Frontis-MA1-35B-GGUF

Image-Text-to-Text • 35B • Updated 5 days ago • 1.19k • 6

LiquidAI/LFM2-2.6B-GGUF

Text Generation • 3B • Updated Mar 30 • 10.1k • 60

LiquidAI/LFM2-VL-3B-GGUF

Image-Text-to-Text • 3B • Updated 25 days ago • 5.62k • 51

LiquidAI/LFM2.5-VL-1.6B-GGUF

Image-Text-to-Text • 1B • Updated 13 days ago • 71.5k • 102

LiquidAI/LFM2.5-Audio-1.5B-GGUF

1B • Updated Mar 30 • 29.1k • 121

LiquidAI/LFM2-24B-A2B-GGUF

Text Generation • 24B • Updated Mar 30 • 3.71k • 145

Jiunsong/supergemma4-26b-uncensored-gguf-v2

Text Generation • 25B • Updated Apr 12 • 61.6k • 960

singulared/Ornith-1.0-35B-MTP-GGUF

Text Generation • 36B • Updated 13 days ago • 10.1k • 9

Myric/Laguna-S-2.1-APEX-GGUF

Text Generation • 118B • Updated 1 day ago • 36.4k • 18

lmcoleman/Qwen3.6-27B-Fable-Fusion-711-MTP-ROCmFPX-GGUF

Text Generation • 0.5B • Updated about 8 hours ago • 4.44k • 5

tarruda/DeepSeek-V4-Flash-0731-GGUF

Text Generation • 20B • Updated about 13 hours ago • 692 • 5

LiquidAI/LFM2-2.6B-Exp-GGUF

Text Generation • 3B • Updated Mar 30 • 2.69k • 69

LiquidAI/LFM2.5-1.2B-Base-GGUF

Text Generation • 1B • Updated Jan 5 • 805 • 25

LiquidAI/LFM2.5-1.2B-JP-GGUF

Text Generation • 1B • Updated Mar 30 • 1.25k • 34

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 68.7k • 763

LiquidAI/LFM2.5-350M-GGUF

Text Generation • 0.4B • Updated Apr 8 • 51.7k • 90

LiquidAI/LFM2.5-VL-450M-GGUF

Image-Text-to-Text • 0.4B • Updated 26 days ago • 9.38k • 61

Jackrong/Qwopus3.5-9B-Coder-GGUF

Image-Text-to-Text • 9B • Updated Jul 1 • 20.6k • 327

AlicanKiraz0/Titus-CybersecurityLLM-v1.0-Q4_K_M-No-MTP-GGUF

Text Generation • 35B • Updated Jun 1 • 1.37k • 30

bytkim/Qwen3.6-27B-MTP-pi-reasoning-GGUF

Image-Text-to-Text • 27B • Updated Jun 20 • 2.94k • 59