PEFT How to use tttx/model_step2_3augs_buffer_short with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("deepseek-ai/DeepSeek-R1-Distill-Qwen-32B")
model = PeftModel.from_pretrained(base_model, "tttx/model_step2_3augs_buffer_short") 
