Q4_0 files built for the Hexagon NPU. Every operation runs on the NPU; measured on a Snapdragon 8 Elite Gen 5.
AI & ML interests
KV cache compression, inference optimization, model compression
Recent Activity
Q4_0 files built for the Hexagon NPU. Every operation runs on the NPU; measured on a Snapdragon 8 Elite Gen 5.
Calibrated GGUFs for phones, laptops and GPUs, each measured against the strongest public file at equal size. Receipts in every card.
Compressed KV cache for vLLM and llama.cpp. Three-arm, needle-gated receipts, reproducible with one command.