Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up
arnabsanyal 's Collections
LazyWeights

LazyWeights

updated 3 days ago

Decode-on-demand edge LLMs: Huffman-coded llama.cpp formats (arXiv 2611.17108)

Upvote
-

  • arnabsanyal/LazyWeights-Phi-3-mini-4k-instruct

    Text Generation • 4B • Updated 3 days ago • 109

  • arnabsanyal/LazyWeights-Mistral-7B-Instruct-v0.2

    Text Generation • 7B • Updated 3 days ago • 106

  • arnabsanyal/LazyWeights-SmolLM-1.7B-Instruct

    Text Generation • 2B • Updated 3 days ago • 181

  • LazyWeights: Decode-on-Demand Edge LLMs

    Paper • 2611.17108 • Published 5 days ago

    Note LazyWeights: Decode-on-Demand Edge LLMs


  • arnabsanyal/lazyWeights

    Text Generation • Updated 3 days ago • 44

    Note Index of the three model repos

Upvote
-
  • Collection guide
  • Browse collections
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs