TheDrainFlorist commited on
Commit
0f0f4e5
·
verified ·
1 Parent(s): e8e9b8f

paper v5 (10.5281/zenodo.23147587)

Browse files
Files changed (1) hide show
  1. README.md +8 -12
README.md CHANGED
@@ -1,5 +1,5 @@
1
  ---
2
- title: Below Six Bits
3
  emoji: 🧮
4
  colorFrom: gray
5
  colorTo: blue
@@ -8,16 +8,12 @@ pinned: false
8
  license: cc-by-4.0
9
  ---
10
 
11
- # Data-Free Vector Quantization Beats Affine Quantization at Matched Bytes Below 6 Bits
12
 
13
- Version 4, 2026-08-27. Vector quantization of three models — Qwen3.5-397B-A17B,
14
- Qwen3.6-35B-A3B, and the dense Qwen3.8-27B — measured against uniform and
15
- mixed-bit-depth calibrated affine builds at matched or smaller file sizes.
 
 
16
 
17
- No calibration corpus, no activations, no teacher model: codebooks are fit by
18
- k-means over the weight tensors alone.
19
-
20
- Thirteen artifacts spanning the three ladders are published with pinned
21
- revisions: see the [model repositories](https://huggingface.co/TheDrainFlorist).
22
-
23
- DOI (all versions): [10.5281/zenodo.22119017](https://doi.org/10.5281/zenodo.22119017)
 
1
  ---
2
+ title: Below Five Bits
3
  emoji: 🧮
4
  colorFrom: gray
5
  colorTo: blue
 
8
  license: cc-by-4.0
9
  ---
10
 
11
+ # Data-Free Vector Quantization Beats Affine Quantization at Matched Bytes Below 5 Bits
12
 
13
+ Version 5, October 2026 (doi:10.5281/zenodo.23147587; all versions:
14
+ 10.5281/zenodo.22119017). Vector quantization of Qwen3.5-397B-A17B,
15
+ Qwen3.6-35B-A3B and the dense Qwen3.8-27B, measured against data-free
16
+ round-to-nearest affine quantization with every other tensor held
17
+ byte-identical. No calibration data.
18
 
19
+ The VQ builds measured in the paper are published: https://huggingface.co/TheDrainFlorist