Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

17

Base only

Active filters: iq4_ks

Austriani/Gemma-4-E2B-it-ik_llama.cpp

Text Generation • 5B • Updated about 2 hours ago • 651 • 1

Austriani/Nemotron-3.5-Bolt-E4B-Heretic-ik_llama.cpp

Text Generation • 7B • Updated about 2 hours ago • 257 • 1

Austriani/MiniCPM5-2B-Heretic-ARA-ik_llama.cpp

Text Generation • 3B • Updated about 2 hours ago • 218 • 1

Austriani/Split-Untied-31B-ik_llama.cpp

Text Generation • 32B • Updated 20 minutes ago • 1

KeinNiemand/Qwen3.5-122B-A10B-IK_GGUF

Text Generation • 122B • Updated Mar 13 • 70 • 2

KeinNiemand/Qwen3.5-122B-A10B-abliterix-IK_GGUF

Text Generation • 122B • Updated Apr 14 • 38 • 3

RDson/Qwen3.6-27B-IQ4_KS-GGUF

Text Generation • 27B • Updated Apr 23 • 20 • 3

RDson/Qwen3.6-27B-MTP-IQ4_KS-GGUF

Text Generation • 27B • Updated May 2 • 87 • 7

Levosilimo/Qwen3.6-35B-A3B-Asymmetric-IQ4_KS-GGUF

Text Generation • 36B • Updated May 18 • 34

cHunter789/Qwen3.6-27B-i1-IQ4_KS-GGUF

Text Generation • 27B • Updated Jun 23 • 101 • 28

KeinNiemand/Qwopus3.5-122B-A10B-Kimi-K2.6-destill-healed-abliterated-IK_GGUF

Text Generation • 125B • Updated May 27 • 319 • 4

KeinNiemand/Kuwutu-7B-CYOA-IK-GGUF

Text Generation • 8B • Updated Jun 17 • 36

AnthonyL1996/Qwopus3.6-27B-Coder-ik-MTP-GGUF

Text Generation • 27B • Updated Jun 18 • 142 • 1

cHunter789/Qwen3.6-27B-i1-IQ4_KS_KT-GGUF

Text Generation • 27B • Updated Aug 8 • 206 • 4

Koshkasa/sophosympatheia_Magistry-24B-v1.1-IQ4_KS.gguf

Text Generation • 24B • Updated Jul 27 • 25

cHunter789/Qwen3.8-27B-i1-IQ4_KS_KT-GGUF

Image-Text-to-Text • 27B • Updated Sep 28 • 16.8k • 44

georuffus/Qwen3.8-27B-i1-IQ4_KS_KT-GGUF

Image-Text-to-Text • 27B • Updated Aug 15 • 40 • 1