How to use jatingocodeo/phi2-grpo with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("microsoft/phi-2") model = PeftModel.from_pretrained(base_model, "jatingocodeo/phi2-grpo")
ab7111c
1
2
3
4
version https://git-lfs.github.com/spec/v1 oid sha256:ccaf0a175a504a6814f48634cf6eedb56788ebc9c16ab9403226b2da8f318d45 size 6072
