KV cache · more users per GPU Collection Compressed KV cache for vLLM and llama.cpp. Three-arm, needle-gated receipts, reproducible with one command. • 5 items • Updated 5 days ago
Hi-Fi GGUF · closer to the original, same size Collection Calibrated GGUFs for phones, laptops and GPUs, each measured against the strongest public file at equal size. Receipts in every card. • 11 items • Updated 5 days ago
NPU-native GGUF · Snapdragon Hexagon Collection Q4_0 files built for the Hexagon NPU. Every operation runs on the NPU; measured on a Snapdragon 8 Elite Gen 5. • 2 items • Updated 5 days ago