Instructions to use isaiahbjork/tinyllama-function-calling-v0.1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use isaiahbjork/tinyllama-function-calling-v0.1 with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("unsloth/tinyllama-bnb-4bit") model = PeftModel.from_pretrained(base_model, "isaiahbjork/tinyllama-function-calling-v0.1") - Notebooks
- Google Colab
- Kaggle
File size: 420 Bytes
adc5b63 7a78936 adc5b63 9eec47c 217beb9 206f88e 217beb9 1bd6f86 898a9b9 1bd6f86 372667d | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 | ---
library_name: peft
base_model: unsloth/tinyllama-bnb-4bit
---
# Function Calling Adapter for Tiny Llama 1.1B v1.0
Formats response to {'message': '', 'function_call': None, 'args': []}
v0.1 - Doesn't call functions yet needs further fine-tuning, only formats message into JSON.
Make a copy of the colab to inference the model
https://store.isaiahbjork.com/l/tiny-llama-finetuning-guide
Finetuned with unsloth.ai |