Transformers
PyTorch
Safetensors
GGUF
English
llama
text-generation-inference
unsloth
trl
sft
8-bit precision
How to use from
LemonadeRun and chat with the model
lemonade run user.model-Q8_0List all available models
lemonade listQuick Links
Uploaded model
- Developed by: developerZoyal
- License: apache-2.0
- Finetuned from model : unsloth/meta-llama-3.1-8b-bnb-4bit
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.
- Downloads last month
- 33
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support
Pull the model
# Download Lemonade from https://lemonade-server.ai/lemonade pull DeveloperZoyel/model:Q8_0