yahma/alpaca-cleaned
Viewer • Updated • 51.8k • 28.6k • 869
How to use XeroCodes/hawk-small-1.1b with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("unsloth/tinyllama-bnb-4bit")
model = PeftModel.from_pretrained(base_model, "XeroCodes/hawk-small-1.1b")This hawk-small-1.1b model is a fine-tuned version of the tinyllama-bnb-4bit model, specifically optimized for enhanced conversational capabilities. The model has been trained on a diverse dataset to improve its ability to understand and generate human-like responses in various conversational contexts.
Base model
unsloth/tinyllama-bnb-4bit