How to use from
Lemonade
Pull the model
# Download Lemonade from https://lemonade-server.ai/
lemonade pull ArunKr/LLM-Models:Q4_K_M_SHARDS
Run and chat with the model
lemonade run user.LLM-Models-Q4_K_M_SHARDS
List all available models
lemonade list
Quick Links

YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

Downloads last month
12
GGUF
Model size
71B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Collection including ArunKr/LLM-Models