README: precision notes and changelog
Browse files
README.md
CHANGED
|
@@ -1,3 +1,23 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: mit
|
| 3 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
---
|
| 4 |
+
|
| 5 |
+
# codec.cpp GGUFs
|
| 6 |
+
|
| 7 |
+
Audio codec GGUFs for [codec.cpp](https://github.com/mybigday/codec.cpp): IBM `DAC.speech.v1.0`
|
| 8 |
+
(24 kHz), NVIDIA NeMo Nano Codec (22.05 kHz, 0.6 kbps, 12.5 fps) and WavTokenizer-large-speech
|
| 9 |
+
(75 tokens/s). Each comes as F32, F16 (no suffix) and Q8_0 / Q5_K_M / Q4_K_M.
|
| 10 |
+
|
| 11 |
+
codec.cpp computes every weight at the precision stored in the GGUF: F16 files run F16 kernels,
|
| 12 |
+
Q8_0 files run Q8_0 kernels. F16 is the default; the quantized files trade quality for size and
|
| 13 |
+
speed (for DAC.speech, decode-only SNR vs F32 is ~37 dB at Q8_0, ~27 dB at Q5_K_M, ~23 dB at
|
| 14 |
+
Q4_K_M on a speech clip; end-to-end encode+decode is lower because quantized encoders flip codes).
|
| 15 |
+
|
| 16 |
+
## Changelog
|
| 17 |
+
|
| 18 |
+
- 2026-10-18: `ibm-research--DAC.speech-{Q8_0,Q5_K_M,Q4_K_M}.gguf` regenerated. Their quantized
|
| 19 |
+
conv kernels now use the layouts codec.cpp can run quantized: conv1d kernels flattened to
|
| 20 |
+
`(K*C_in, 1, C_out)`, ConvTranspose kernels `(C_in, C_out, K)`. The previous files used the
|
| 21 |
+
`(C_out, C_in, K)` layout, which only ran because older runtimes dequantized every weight to F32.
|
| 22 |
+
**These files need codec.cpp 961162a or newer.** F32/F16 files and the NeMo / WavTokenizer files
|
| 23 |
+
are unchanged.
|