Decode-on-demand edge LLMs: Huffman-coded llama.cpp formats (arXiv 2611.17108)
-
arnabsanyal/LazyWeights-Phi-3-mini-4k-instruct
Text Generation • 4B • Updated • 109 -
arnabsanyal/LazyWeights-Mistral-7B-Instruct-v0.2
Text Generation • 7B • Updated • 106 -
arnabsanyal/LazyWeights-SmolLM-1.7B-Instruct
Text Generation • 2B • Updated • 181 -
LazyWeights: Decode-on-Demand Edge LLMs
Paper • 2611.17108 • Published