6block/Qwen3-4B-GGUF
Text Generation • 4B • Updated • 899
All Qwen3 quantized builds: GGUF, FP8, AWQ and GPTQ. Covers 4B to 32B dense and 30B-A3B MoE.
Note Qwen3-4B GGUF — 7 tiers, imatrix-calibrated
Note Qwen3-4B FP8
Note Qwen3-4B AWQ
Note Qwen3-4B GPTQ
Note Qwen3-8B GGUF — 7 tiers, imatrix-calibrated
Note Qwen3-8B FP8
Note Qwen3-8B AWQ
Note Qwen3-8B GPTQ
Note Qwen3-14B GGUF — 7 tiers, imatrix-calibrated
Note Qwen3-14B FP8
Note Qwen3-14B AWQ
Note Qwen3-14B GPTQ
Note Qwen3-30B-A3B GGUF (MoE, ~3B active) — 7 tiers
Note Qwen3-30B-A3B FP8 (MoE)
Note Qwen3-30B-A3B AWQ (MoE)
Note Qwen3-30B-A3B GPTQ (MoE)
Note Qwen3-32B GGUF — 7 tiers, imatrix-calibrated
Note Qwen3-32B FP8
Note Qwen3-32B AWQ
Note Qwen3-32B GPTQ