Instructions to use Vasanth/tiny-chatbot-dpo with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use Vasanth/tiny-chatbot-dpo with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("TinyLlama/TinyLlama-1.1B-Chat-v1.0") model = PeftModel.from_pretrained(base_model, "Vasanth/tiny-chatbot-dpo") - Notebooks
- Google Colab
- Kaggle
File size: 129 Bytes
98c6a8d | 1 2 3 4 | version https://git-lfs.github.com/spec/v1
oid sha256:f6c7b0327808c0c3d7de2be5ae12ec6eaefff0021c7a6a40be44693d7a9b5c86
size 4728
|