metadata
title: Below Five Bits
emoji: 🧮
colorFrom: gray
colorTo: blue
sdk: static
pinned: false
license: cc-by-4.0
Data-Free Vector Quantization Beats Affine Quantization at Matched Bytes Below 5 Bits
Version 5, October 2026 (doi:10.5281/zenodo.23147587; all versions: 10.5281/zenodo.22119017). Vector quantization of Qwen3.5-397B-A17B, Qwen3.6-35B-A3B and the dense Qwen3.8-27B, measured against data-free round-to-nearest affine quantization with every other tensor held byte-identical. No calibration data.
The VQ builds measured in the paper are published: https://huggingface.co/TheDrainFlorist