Methods for compressing the KV cache in transformer inference. E8 lattice, KVarN, TurboQuant, KIVI.
João André Gomes Marques
jmarquex
AI & ML interests
None yet
Recent Activity
updated a Space 7 days ago
jmarquex/nexusquant-demo updated a model 16 days ago
jmarquex/nexusquant updated a collection 27 days ago
KV Cache Compression MethodsOrganizations
None yet