Quantization Explorer
⚙
Explore quantization: FP8, INT8, INT4 and trade-offs.
Open Weight Quantization, Compression and Efficient Inferenc
Curated resources for FP8, INT8, INT4, AWQ, GPTQ, QLoRA and efficient open-weight inference.
-
-
Quantization
🐥6Explore quantization examples with Flan-T5, OPT, and Whisper
-
Qwen/Qwen3-8B-AWQ
Text Generation • 8B • Updated • 2.24M • 59 -
Qwen/Qwen3-0.6B-GPTQ-Int8
Text Generation • 0.6B • Updated • 985 • 14 -
QLoRA: Efficient Finetuning of Quantized LLMs
Paper • 2305.14314 • Published • 64 -
GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
Paper • 2210.17323 • Published • 12 -
AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
Paper • 2306.00978 • Published • 16