Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

11,082

Base only

Active filters: llama.cpp

jmsmuigai/Qwen3-8B-Gikuyu-Mugambo

8B • Updated Jul 26 • 44 • 1

ewin-reg/MiniCPM5-1B-Agentic-Tooluse-v3-GGUF

Text Generation • 1B • Updated Jul 29 • 2.24k • 13

MrPentaxide/HackerAI-Pro-Agent-8B-GGUF

8B • Updated Jul 27 • 1.25k • 1

murillo2000/Kimi-K3-0.40B-GGUF

Text Generation • 0.4B • Updated Jul 29 • 490 • 5

bullerwins/DeepSeek-V4-Flash-0731-GGUF

Text Generation • 284B • Updated Aug 3 • 2.33k • 9

Myric/KAT-Coder-V2.5-Dev-MTP-APEX-GGUF

Text Generation • 35B • Updated Aug 21 • 9.9k • 12

Magurofg/pocket-lm-269m

Text Generation • 0.3B • Updated Aug 28 • 54 • 1

alesha-pro/DeepSeek-V4-Flash-0731-REAP-K160-GGUF

Text Generation • 180B • Updated Aug 5 • 75 • 3

vcruz305/Kimi-K3-GGUF

Text Generation • 1.4T • Updated 6 days ago • 578 • 6

mradermacher/soulbox-cbt-therapy-1.5b-GGUF

Text Generation • 2B • Updated Aug 7 • 497 • 1

puwaer/DeepSeek-V4-Flash-0731-reap-150b-gguf

Text Generation • 150B • Updated Aug 26 • 16.2k • 15

kingjones777/DeepSeek-V4-Flash-180B-ROCmFP4-STRIX_LEAN-GGUF

Text Generation • 180B • Updated Sep 1 • 1.42k • 4

The-freezer/Muse-Glimmer-30B-Abliterated-GGUF

Image-Text-to-Text • 28B • Updated Aug 15 • 21.6k • 51

bloomer010/Ling-3.0-tiny-GGUF

Text Generation • 8B • Updated 13 days ago • 216k • 109

AtomicChat/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-GGUF

Text Generation • 33B • Updated Aug 12 • 6.23k • 12

LiquidAI/LFM2.5-VL-3B-GGUF

Image-Text-to-Text • 3B • Updated Aug 31 • 24.2k • 68

NANI-Nithin/MiniCPM5-1B-GGUF

Text Generation • 1B • Updated 29 days ago • 4.26k • 2

AtomicChat/Qwen3.8-27B-GGUF

Image-Text-to-Text • 27B • Updated Aug 18 • 45.8k • 176

ibm-granite/granite-4.2-30b-GGUF

29B • Updated about 1 month ago • 328k • 16

superwhisper/s1-mini-GGUF

Text Generation • 0.8B • Updated Aug 28 • 269k • 39

Jared2026/DeepSeek-V4-Flash-0731-Abliterated-UD-Q8_K_XL-GGUF

Text Generation • 284B • Updated Aug 15 • 2

el4/SIQ-1-35B-ONYX-GGUF

Text Generation • 35B • Updated Aug 13 • 208 • 4

qign/Qwen3-VL-8B-Instruct-abliterated-v2-GGUF

Image-Text-to-Text • 8B • Updated Aug 14 • 1.96k • 1

cds1/icdu_dpo_qwen3.5_9b_v2

Text Generation • 9B • Updated 25 days ago • 303 • 2

linuxid10t/G9v3-39A5B-GGUF

Text Generation • 39B • Updated Aug 22 • 1.26k • 16

Jackrong/Qwen3.8-27B-MTP-GGUF

Image-Text-to-Text • 0.5B • Updated Aug 16 • 10.4k • 52

pugant/Qwen3.8-27B-MTP-Q4_0_ROCMFP4_STRIX_LEAN

Text Generation • 27B • Updated 28 days ago • 746 • 7

williamliao/Qwen3.8-27B-NVFP4-GGUF

Text Generation • 27B • Updated 21 days ago • 11.7k • 13

mlasli/Qwen3.8-27B-Heretic-Uncensored-Q6_K-GGUF

Text Generation • 27B • Updated Sep 1 • 1.93k • 4

peculiar-ragdoll/Occult-Nail-1.0-35B-A3B-GGUF

Image-Text-to-Text • 35B • Updated Aug 16 • 3.29k • 11