File size: 608 Bytes
942eb59 0f0f4e5 41260c3 942eb59 41260c3 942eb59 41260c3 942eb59 0f0f4e5 41260c3 0f0f4e5 41260c3 0f0f4e5 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 | ---
title: Below Five Bits
emoji: 🧮
colorFrom: gray
colorTo: blue
sdk: static
pinned: false
license: cc-by-4.0
---
# Data-Free Vector Quantization Beats Affine Quantization at Matched Bytes Below 5 Bits
Version 5, October 2026 (doi:10.5281/zenodo.23147587; all versions:
10.5281/zenodo.22119017). Vector quantization of Qwen3.5-397B-A17B,
Qwen3.6-35B-A3B and the dense Qwen3.8-27B, measured against data-free
round-to-nearest affine quantization with every other tensor held
byte-identical. No calibration data.
The VQ builds measured in the paper are published: https://huggingface.co/TheDrainFlorist
|