add mul_mat_id, and compile upstream's kernels as they ship
Marc Sun
9534e0b
`mul_mat_id` is ggml's expert-routed matmul: one dispatch for a whole bank, given the router's
choices, where the alternative is a gemv per expert per layer. On Qwen3.5-35B-A3B that moved the
expert banks from 83% of decode time to 18%.
The rest is the vendoring. ggml's Metal backend was one translation unit, so this package cut its
own subset out of it with a `trim_shader.py` pass; upstream splits it per operation now, so
`vendor.py` copies the files this dispatches and `build.toml` compiles them directly -- no
generated shader, no generator.
Pin moves to llama.cpp 50f068ff.
GGUF kernels: dequantize + fused gemv over packed blocks, 9 CUDA variants
