Function Calling Adapter for Tiny Llama 1.1B v1.0
Formats response to {'message': '', 'function_call': None, 'args': []}
v0.1 - Doesn't call functions yet needs further fine-tuning, only formats message into JSON.
Make a copy of the colab to inference the model https://store.isaiahbjork.com/l/tiny-llama-finetuning-guide
Finetuned with unsloth.ai
- Downloads last month
- 5
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for isaiahbjork/tinyllama-function-calling-v0.1
Base model
unsloth/tinyllama-bnb-4bit
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("unsloth/tinyllama-bnb-4bit") model = PeftModel.from_pretrained(base_model, "isaiahbjork/tinyllama-function-calling-v0.1")