PEFT How to use Mustain/finetuned_stableAI_squad_4bit with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("stabilityai/japanese-stablelm-instruct-alpha-7b-v2")
model = PeftModel.from_pretrained(base_model, "Mustain/finetuned_stableAI_squad_4bit") 
