PEFT How to use jdchang/tldr_rm_adapter with PEFT:
from peft import PeftModel
from transformers import AutoModelForSequenceClassification
base_model = AutoModelForSequenceClassification.from_pretrained("CarperAI/openai_summarize_tldr_sft")
model = PeftModel.from_pretrained(base_model, "jdchang/tldr_rm_adapter") 
