Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

post-training-quantization

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

146

Base only

Active filters: post-training-quantization

88plug/Qwen3-Omni-30B-W4A16

Text Generation • 35B • Updated Jul 10 • 141 • 2

ims-lab/Qwen3-14B-base-QTEA

Text Generation • Updated Sep 2

jkim96/Nemotron-3-Ultra-550B-A55B-DASHQ-INT2-g32

Text Generation • 2B • Updated Aug 13 • 54 • 1

jkim96/gemma-4-31B-it-DASHQ-INT2-g32

Image-Text-to-Text • 2B • Updated Aug 13 • 26

jkim96/GLM-4.7-DASHQ-INT2-g32

Text Generation • 2B • Updated Aug 13 • 31

jkim96/Mistral-Medium-3.5-128B-DASHQ-INT2-g32

Image-Text-to-Text • 6B • Updated Aug 13 • 21 • 2

jkim96/Qwen3.5-35B-A3B-DASHQ-INT2-g32

Text Generation • 1B • Updated Aug 13 • 27

jkim96/Qwen3.6-35B-A3B-DASHQ-INT2-g32

Text Generation • 1B • Updated Aug 13 • 29

jkim96/Llama-3.1-70B-Instruct-DASHQ-INT2-g32

Text Generation • 2B • Updated Aug 13 • 13

jkim96/Llama-3.3-70B-Instruct-DASHQ-INT2-g32

Text Generation • 2B • Updated Aug 13 • 22

jkim96/Llama-3.1-405B-Instruct-DASHQ-INT2-g32

Text Generation • 4B • Updated Aug 13 • 20

88plug/Kimi-VL-A3B-Thinking-2506-W8A16

Image-Text-to-Text • 17B • Updated Jul 13 • 103

88plug/Kimi-VL-A3B-Thinking-2506-W4A16

Image-Text-to-Text • 17B • Updated Jul 10 • 40

QuantNAS/QuantNAS

yuesheng123/MiniCPM-o-4.5-W4A16

Image-Text-to-Text • 9B • Updated Jul 28 • 11

CezarJedi/Qwen3.5-9B-Abliterated-NVFP4-FP8KV

Text Generation • 6B • Updated Aug 7 • 149 • 1

armanibadboy/WAL-Ternary-27B-RC1

Text Generation • Updated Aug 9 • 31

yitongl/minimax-h3-nvfp4-lora-recovery

jkim96/phi-4-DASHQ-INT4-g128

Text Generation • 1B • Updated Aug 13 • 19

jkim96/phi-4-DASHQ-INT3-g128

Text Generation • 1B • Updated Aug 13 • 36

jkim96/phi-4-DASHQ-INT3-g64

Text Generation • 1B • Updated Aug 13 • 51

jkim96/phi-4-DASHQ-INT3-g32

Text Generation • 1B • Updated Aug 13 • 50

jkim96/phi-4-DASHQ-INT2-g32

Text Generation • 1B • Updated Aug 13 • 28

SusanHill/jkim96-qwen3.6-35b-a3b-dashq-int2-g32-0811-1500

Text Generation • 1B • Updated Aug 11

SusanHill/jkim96-qwen3.5-35b-a3b-dashq-int2-g32-0811-1515

Text Generation • 1B • Updated Aug 11

praveenkumarpranjal/LFM2.5-2.6B-4bit-PathPack-Q

Text Generation • 3B • Updated Aug 11 • 40

jkim96/DeepSeek-R1-Distill-Qwen-32B-DASHQ-INT4-g128

Text Generation • 2B • Updated Aug 13 • 25

jkim96/DeepSeek-R1-Distill-Qwen-32B-DASHQ-INT3-g128

Text Generation • 2B • Updated Aug 13 • 33

jkim96/DeepSeek-R1-Distill-Qwen-32B-DASHQ-INT3-g64

Text Generation • 2B • Updated Aug 13 • 29

jkim96/DeepSeek-R1-Distill-Qwen-32B-DASHQ-INT3-g32

Text Generation • 2B • Updated Aug 13 • 44