PEFT How to use renyulin/gpt2_es_rm with PEFT:
from peft import PeftModel
from transformers import AutoModelForSequenceClassification
base_model = AutoModelForSequenceClassification.from_pretrained("gpt2")
model = PeftModel.from_pretrained(base_model, "renyulin/gpt2_es_rm") 
