Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

200

Base only

Active filters: ik_llama.cpp

Koshkasa/TheDrummer_Skyfall-31B-v4.2-IQ4_KSS-GGUF

Text Generation • 31B • Updated Aug 17 • 121 • 1

Koshkasa/DarkArtsForge_Zepar-24B-v1-IQ4_KS-GGUF

Text Generation • 24B • Updated Jul 26 • 31

Koshkasa/TheDrummer_Valkyrie-49B-v2.1-IQ3_KT-GGUF

Text Generation • 50B • Updated Jul 29 • 88

Koshkasa/sophosympatheia_Magistry-24B-v1.1-IQ5_KS-GGUF

Text Generation • 24B • Updated Jul 27 • 24

Koshkasa/sophosympatheia_Magistry-24B-v1.1-IQ4_KS.gguf

Text Generation • 24B • Updated Jul 27 • 45

Koshkasa/TheDrummer_Big-Alice-28B-v1-IQ4_KT-GGUF

Text Generation • 29B • Updated Jul 28 • 23

Koshkasa/TheDrummer_Snowpiercer-15B-v4-IQ5_K-GGUF

Text Generation • 15B • Updated Jul 28 • 60

Koshkasa/TheDrummer_Big-Alice-28B-v1-mix_IQ3_K-GGUF

Text Generation • 29B • Updated Jul 28 • 27

Koshkasa/ShyliaSafetensors_Ariel-Alloy-V1-24B-Heretic-IQ4_K_M.GGUF

Text Generation • 24B • Updated Jul 29 • 40

Koshkasa/DarkArtsForge_Morbid-Miasma-24B-Q4-GGUFs

Text Generation • 24B • Updated Jul 29 • 130 • 3

Koshkasa/Vortex5_G4-Dark-Soul-26B-A4B-MXFP4_MoE-GGUF

Text Generation • 25B • Updated Jul 31 • 58 • 1

sokann/DeepSeek-V4-Flash-0731-GGUF

284B • Updated Aug 24 • 148 • 3

Koshkasa/Vortex5_G4-Midnight-Macaw-26B-A4B-MXFP4_MOE-GGUF

Text Generation • 25B • Updated Aug 2 • 46

Downtown-Case/DeepSeek-V4-Flash-0731-128GB-RAM-IK-GGUF

Text Generation • 284B • Updated Aug 9 • 26 • 6

cdtio33/Ornith-1.0-397B-IQ2_KS-DFlash-Drafter-GGUF

Text Generation • 1B • Updated Aug 10 • 207 • 1

ubergarm/Qwen3.8-27B-GGUF

Text Generation • 29B • Updated Aug 23 • 3.68k • 28

cHunter789/Qwen3.8-27B-i1-IQ4_KS_KT-GGUF

Image-Text-to-Text • 27B • Updated 9 days ago • 6.89k • 44

PollardWeights/Qwen2.5-1.5B-Instruct-Pollard

Text Generation • 2B • Updated 28 days ago • 352

georuffus/Qwen3.8-27B-i1-IQ4_KS_KT-GGUF

Image-Text-to-Text • 27B • Updated Aug 15 • 58 • 1

Simplepotat/Qwen3.8-27B-IQ5_KS-GGUF

Text Generation • 27B • Updated Aug 16 • 193 • 2

Koshkasa/Gryphe_WorldSim-Opus-3.6-35B-A3B-IQ4_KT-GGUF

35B • Updated Aug 16 • 42

cso3987/Qwen3.5-122B-A10B-DFlash-GGUF

Text Generation • 0.5B • Updated Aug 16 • 47

Koshkasa/TheDrummer_Skyfall-31B-v4.2_16G-checkerboard-trellis-GGUF

Text Generation • 31B • Updated Aug 17 • 172

Rabbit-Hole-Ai/DeepSeek-V4-Flash-0731-MXFP4-GGUF

Text Generation • 284B • Updated Sep 3 • 142 • 2

PollardWeights/Ling-3.0-tiny-Pollard

Text Generation • 8B • Updated 27 days ago • 743 • 1

PollardWeights/Qwen2.5-Coder-1.5B-Instruct-Pollard

Text Generation • 2B • Updated 28 days ago • 310 • 1

PollardWeights/Carnice-V3-27b-Pollard

Image-Text-to-Text • 27B • Updated 24 days ago • 1.8k • 1

PollardWeights/Qwen3.8-27B-Pollard

Image-Text-to-Text • 27B • Updated 25 days ago • 1.05k

Koshkasa/MuXodious_GLM-4.7-Flash-absolute-heresy-mixed-trellis-GGUF

Text Generation • 30B • Updated Aug 26 • 225

KeinNiemand/DeepSeek-V4-Flash-0731-IK_GGUF

Text Generation • 284B • Updated 23 days ago • 7.8k • 8