Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,289

Base only

Active filters: quantization

elrashid/gate-qwen2.5-7b-instruct-l14

elrashid/gate-qwen3-8b-l18

elrashid/gate-gemma-2-2b-it-l13

elrashid/gate-gemma-2-9b-it-l21

elrashid/gate-gemma-3-1b-it-l13

elrashid/gate-gemma-3-4b-it-l17

elrashid/gate-gemma-4-e2b-it-l17

elrashid/gate-gemma-4-e4b-it-l21

elrashid/gate-llama-3.1-8b-instruct-l16

elrashid/gate-phi-4-mini-instruct-l16

theLittleStone/Qwen3.6-27B-AEON-Ultimate-Uncensored-MTP-GGUF

Text Generation • 27B • Updated Jul 5 • 408 • 1

Danny-Dasilva/gemma-4-12B-it-W4A16-GPTQ-g32-DSpark

Text Generation • 12B • Updated Jul 4 • 1.32k

madeby561/GLM-5.2-MXFP8-NVFP4-NF3-Hybrid

318B • Updated Jul 28 • 125 • 70

Helllbos/Qwen3-8B-INT8

Text Generation • 8B • Updated Jul 9 • 22 • 1

maczzinatui/Qwen3.6-27B-MTP-ROCmFP4_FAST-GGUF

27B • Updated Jul 11 • 38

maczzinatui/Grug-12B-ROCmFP4_FAST-GGUF

12B • Updated Jul 11 • 40

yasu-oh/gemma-4-31B-it-qat-NVFP4

Image-Text-to-Text • 18B • Updated Aug 21 • 125 • 1

maczzinatui/Qwen3.6-27B-MTP-TQ3_4S-GGUF

27B • Updated Jul 11 • 50

realrebelai/SeFi-Image-5B-Base

5B • Updated Jul 6 • 61 • 4

realrebelai/SeFi-Image-5B-Turbo

5B • Updated Jul 6 • 436 • 7

chfm/Boogu-Image-Edit-Turbo_GGUFs

10B • Updated Jul 6 • 330

nota-ai/Qwen3.5-4B-QAD-W4A16

Text Generation • 5B • Updated Jul 6 • 1.73k • 3

nerkyor/Step-3.7-Flash-180B-LynnStyle-GLM52-SFT-GPT55-RL-GGUF

Text Generation • 181B • Updated Jul 7 • 295 • 3

jmarquex/nexusquant

nerkyor/Step-3.7-Flash-180B-LynnStyle-GLM52-SFT-GPT55-RL

Text Generation • 139B • Updated Jul 7 • 311 • 1

pablohassan/Qwen3.6-27B-NVFP4-FR

Text Generation • 19B • Updated Jul 14 • 78 • 1

lhs101/wint4-quantized-models

aquaman164/GLM-5.2-VQ-1.9bit

Text Generation • 50B • Updated Jul 8 • 13

realrebelai/NL-Diffusion-Image_GGUF

10B • Updated Jul 9 • 493 • 1

Danny-Dasilva/Qwen3-4B-antidoom-W4A16-GPTQ-g32-DSpark

Text Generation • 4B • Updated Jul 7 • 22