hans00 commited on
Commit
0ff9d37
·
verified ·
1 Parent(s): 14f37cf

README: precision notes and changelog

Browse files
Files changed (1) hide show
  1. README.md +23 -3
README.md CHANGED
@@ -1,3 +1,23 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ ---
4
+
5
+ # codec.cpp GGUFs
6
+
7
+ Audio codec GGUFs for [codec.cpp](https://github.com/mybigday/codec.cpp): IBM `DAC.speech.v1.0`
8
+ (24 kHz), NVIDIA NeMo Nano Codec (22.05 kHz, 0.6 kbps, 12.5 fps) and WavTokenizer-large-speech
9
+ (75 tokens/s). Each comes as F32, F16 (no suffix) and Q8_0 / Q5_K_M / Q4_K_M.
10
+
11
+ codec.cpp computes every weight at the precision stored in the GGUF: F16 files run F16 kernels,
12
+ Q8_0 files run Q8_0 kernels. F16 is the default; the quantized files trade quality for size and
13
+ speed (for DAC.speech, decode-only SNR vs F32 is ~37 dB at Q8_0, ~27 dB at Q5_K_M, ~23 dB at
14
+ Q4_K_M on a speech clip; end-to-end encode+decode is lower because quantized encoders flip codes).
15
+
16
+ ## Changelog
17
+
18
+ - 2026-10-18: `ibm-research--DAC.speech-{Q8_0,Q5_K_M,Q4_K_M}.gguf` regenerated. Their quantized
19
+ conv kernels now use the layouts codec.cpp can run quantized: conv1d kernels flattened to
20
+ `(K*C_in, 1, C_out)`, ConvTranspose kernels `(C_in, C_out, K)`. The previous files used the
21
+ `(C_out, C_in, K)` layout, which only ran because older runtimes dequantized every weight to F32.
22
+ **These files need codec.cpp 961162a or newer.** F32/F16 files and the NeMo / WavTokenizer files
23
+ are unchanged.