PEFT How to use samaya-ai/RepLLaMA-reproduced with PEFT:
from peft import PeftModel
from transformers import AutoModel
base_model = AutoModel.from_pretrained("meta-llama/Llama-2-7b-hf")
model = PeftModel.from_pretrained(base_model, "samaya-ai/RepLLaMA-reproduced") 
