PEFT How to use cfli/minicpm_mixture with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("openbmb/MiniCPM-2B-dpo-fp32")
model = PeftModel.from_pretrained(base_model, "cfli/minicpm_mixture") 
