Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,299

Base only

Active filters: quantization

jupitersong/madi-whisper-turbo-v3-q8

Automatic Speech Recognition • Updated Jun 22 • 1

cod-tdq/cod-tdq

Updated Jun 22 • 1

syseeker-at-nv/nitrogen-quant

wepiqx/Qwythos-9B-Claude-Mythos-5-1M-MTP-SHQ8-GGUF

Text Generation • 9B • Updated Jun 23 • 354 • 5

donghyunli/Llama-2-70b-KronQ-W4A16

Text Generation • 35B • Updated Jul 14

donghyunli/Llama-2-70b-KronQ-W2A16

Text Generation • 18B • Updated Jul 14

donghyunli/Meta-Llama-3-70B-KronQ-W4A16

Text Generation • 36B • Updated Jul 14

donghyunli/Meta-Llama-3-70B-KronQ-W2A16

Text Generation • 19B • Updated Jul 13

donghyunli/Llama-2-70b-KronQ-W3A16-fake

Text Generation • 69B • Updated Jul 14 • 20

donghyunli/Meta-Llama-3-70B-KronQ-W3A16-fake

Text Generation • 71B • Updated Jul 14 • 13

tonera/vitoom-nunchaku

Updated Jun 30 • 11

JasonW2025/Qwen3.6-35B-A3B-HybridQuant-NVFP4

Image-Text-to-Text • 19B • Updated Jul 4 • 216 • 1

pearsonkyle/tmax-27b-imatrix-MTP-GGUF

Text Generation • 27B • Updated Jul 2 • 264 • 1

JasonW2025/Nemotron-3-Nano-30B-A3B-NVFP4-AWQ

Text Generation • 18B • Updated Jun 23 • 14

kvignesh/phi4-mini-q8_0-gguf

Text Generation • 4B • Updated Jun 23 • 24 • 1

anoopbhargavakm87/Meta-Llama-3-8B-Instruct-4bit-Compressed

Text Generation • 8B • Updated Jun 23 • 11

Arki05/Qwen3.6-27B-GGUF

27B • Updated Jul 23 • 8

xv0y5ncu/gemma-4-12B-it-GLQ-3bpw-e8p-bd

Image-Text-to-Text • 2B • Updated Aug 19 • 5

ShockleyWong/gemma4-e2b-rdk-s100p

Image-Text-to-Text • Updated Jun 24

nameistoken/Step-3.7-Flash-Quark-W4A16

Image-Text-to-Text • 203B • Updated Jun 24 • 34

nameistoken/Step-3.7-Flash-Quark-W8A8

Image-Text-to-Text • 201B • Updated Jun 24 • 17

Abhimanue/TCompress

0.1B • Updated Jun 24

Fredred89/Qwopus3.6-27B-Coder-GGUF-kaitchup-MoQ-4.0

Fredred89/Qwopus3.6-27B-Coder-GGUF-ASI-MoQ-4.0

donghyunli/Llama-2-7b-KronQ-W4A16-g128

Text Generation • 4B • Updated Jul 24 • 59

donghyunli/Llama-2-7b-KronQ-W2A16-g128

Text Generation • 2B • Updated Jul 24 • 75

donghyunli/Meta-Llama-3-8B-KronQ-W4A16-g128

Text Generation • 5B • Updated Jul 13 • 66

donghyunli/Meta-Llama-3-8B-KronQ-W2A16-g128

Text Generation • 3B • Updated Jul 13 • 67

donghyunli/Llama-2-13b-KronQ-W4A16-g128

Text Generation • 7B • Updated Jul 13 • 48

donghyunli/Llama-2-70b-KronQ-W4A16-g128

Text Generation • 36B • Updated Jul 14 • 27