PEFT How to use tttx/model_3k_forcing_3ep_step1 with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("deepseek-ai/DeepSeek-R1-Distill-Qwen-32B")
model = PeftModel.from_pretrained(base_model, "tttx/model_3k_forcing_3ep_step1") 
