How to use ineskoder/ref-model with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("TonyMDSA/Phi-2_finetune_MCQ") model = PeftModel.from_pretrained(base_model, "ineskoder/ref-model")
https://huggingface.co/ineskoder/ref-model/resolve/b05c6a458d4062bc701860920df4fbeb804a2490/tokenizer.json
hf download hf://ineskoder/ref-model@b05c6a458d4062bc701860920df4fbeb804a2490/tokenizer.json
curl -L -o tokenizer.json https://huggingface.co/ineskoder/ref-model/resolve/b05c6a458d4062bc701860920df4fbeb804a2490/tokenizer.json
