Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,556

Base only

Active filters: llama.cpp

AnwarPy/qwen3.5-9b-anwar-hermes-GGUF

Text Generation • 9B • Updated 4 days ago • 1.77k • 2

guideboardlabs/Nanbeige4.2-3B-GGUF

4B • Updated 4 days ago • 609 • 2

vinpix/Ternary-Bonsai-27B-Stock-MTP-GGUF

Text Generation • 29B • Updated 4 days ago • 641 • 2

vcruz305/Solar-Open2-250B-GGUF

250B • Updated 3 days ago • 3.22k • 2

Abiray/Fara1.5-27B-GGUF

Image-Text-to-Text • 27B • Updated 3 days ago • 1.06k • 2

webAI-Official/TwIL-LM

Text Generation • 2B • Updated 2 days ago • 266 • 2

jcbtc/Laguna-S-2.1-NVFP4-GGUF

Text Generation • 118B • Updated 3 days ago • 558 • 2

ProCreations/grug-35b-qat-q4-gguf

35B • Updated 3 days ago • 291 • 2

ibrahima2222/GLM-5.2-Vision-mmproj-GGUF

Image-Text-to-Text • 0.5B • Updated 2 days ago • 32 • 2

AlexanderKyng/Qwen3.6-27B-Fusion-711-Uncensored-MTP-48gb

Image-Text-to-Text • 3.4M • Updated 1 day ago • 199 • 2

el4/Darwin-36B-Opus-OPAL-GGUF

Text Generation • 35B • Updated 17 days ago • 13.8k • 12

sinjab/mxbai-rerank-base-v2-Q4_K_M-GGUF

0.5B • Updated Oct 11, 2025 • 6 • 1

pramodlohra/Qween3_4B_thinking_finetune

4B • Updated Oct 21, 2025 • 26.7k • 6

LiquidAI/LFM2-VL-3B-GGUF

Image-Text-to-Text • 3B • Updated 16 days ago • 5.58k • 46

Jackrong/GPT-5-Distill-Qwen3-4B-Instruct-GGUF

4B • Updated Nov 30, 2025 • 2.92k • 18

AXONVERTEX-AI-RESEARCH/Fara-7B-Q8-GGUF

Image-Text-to-Text • 8B • Updated Nov 25, 2025 • 24 • 3

danielhanchen/functiongemma-gguf

0.3B • Updated Dec 23, 2025 • 27 • 2

glogwa68/granite-4.0-h-1b-DISTILL-glm-4.7-think-GGUF

Text Generation • 1B • Updated Dec 23, 2025 • 273 • 1

LiquidAI/LFM2.5-1.2B-Instruct-GGUF

Text Generation • 1B • Updated Apr 6 • 330k • 196

LiquidAI/LFM2.5-VL-1.6B-GGUF

Image-Text-to-Text • 1B • Updated 4 days ago • 71.9k • 97

LiquidAI/LFM2.5-Audio-1.5B-GGUF

1B • Updated Mar 30 • 29.7k • 116

dieegorenan/Qwen3-linux-commands

4B • Updated Jan 8 • 83 • 1

LiquidAI/LFM2.5-1.2B-Thinking-GGUF

Text Generation • 1B • Updated Apr 6 • 12.7k • 105

pierretokns/SmolVLM-256M-Instruct-GGUF

Image-Text-to-Text • 0.2B • Updated Jan 27 • 143 • 1

rizkysulaeman/Embedding-Gemma-300m

Sentence Similarity • 0.3B • Updated Feb 14 • 620 • 2

prithivMLmods/Qwen3-VL-4B-Instruct-Unredacted-MAX-GGUF

Image-Text-to-Image • 4B • Updated Feb 15 • 2.79k • 9

exdysa/MiniMax-M2.5-REAP-172B-A10B-GGUF-Q4_K_M

Text Generation • 173B • Updated Apr 27 • 46 • 3

audreyt/Gemma-3-TAIDE-12b-Chat-2602-GGUF

13B • Updated Feb 21 • 378 • 5

Jackrong/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

Image-Text-to-Text • 27B • Updated 18 days ago • 106k • 675

ia-espirita/riv-ai

Text Generation • 8B • Updated May 4 • 58 • 5