Instructions to use isaiahbjork/tinyllama-function-calling-v0.1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use isaiahbjork/tinyllama-function-calling-v0.1 with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("unsloth/tinyllama-bnb-4bit") model = PeftModel.from_pretrained(base_model, "isaiahbjork/tinyllama-function-calling-v0.1") - Notebooks
- Google Colab
- Kaggle
Commit ·
1bd6f86
1
Parent(s): 206f88e
Update README.md
Browse files
README.md
CHANGED
|
@@ -9,4 +9,7 @@ Formats response to {'message': '', 'function_call': None, 'args': []}
|
|
| 9 |
|
| 10 |
v0.1 - Doesn't call functions yet needs further fine-tuning, only formats message into JSON.
|
| 11 |
|
|
|
|
|
|
|
|
|
|
| 12 |
Finetuned with unsloth.ai
|
|
|
|
| 9 |
|
| 10 |
v0.1 - Doesn't call functions yet needs further fine-tuning, only formats message into JSON.
|
| 11 |
|
| 12 |
+
Make a copy of the colab to inference the model
|
| 13 |
+
https://colab.research.google.com/drive/1ztZOhkKiRdRxwoxSWSZJc51fwsLMZrK_?usp=sharing
|
| 14 |
+
|
| 15 |
Finetuned with unsloth.ai
|