Instructions to use DUAL-GPO/phi-2-ipo-chatml with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use DUAL-GPO/phi-2-ipo-chatml with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("DUAL-GPO/phi-2-sft-lora-ultrachat-merged") model = PeftModel.from_pretrained(base_model, "DUAL-GPO/phi-2-ipo-chatml") - Notebooks
- Google Colab
- Kaggle
Commit History
-
End of training
Verified signatureac18ecf -
Model save
Verified signature21f5880 -
Training in progress, step 1900
Verified signatureb7f762d -
Training in progress, step 1800
Verified signaturee15cbdf -
Training in progress, step 1700
Verified signature08d9ece -
Training in progress, step 1500
Verified signature23afdd1 -
Training in progress, step 1400
Verified signaturea72833e -
Training in progress, step 1300
Verified signature711c1a0 -
Training in progress, step 1200
Verified signature0cae008 -
Training in progress, step 1100
Verified signaturea6066bc -
Training in progress, step 1000
Verified signature5551a6c -
Training in progress, step 900
Verified signatured62a216 -
Training in progress, step 800
Verified signature6184dd0 -
Training in progress, step 700
Verified signature479a94c -
Training in progress, step 600
Verified signatured3e1bcf -
Training in progress, step 500
Verified signatureca8d06d -
Training in progress, step 400
Verified signature01bfda6 -
Training in progress, step 300
Verified signatureefc5599 -
Training in progress, step 200
Verified signaturedb37c63 -
Training in progress, step 100
Verified signature56eeb1b -
initial commit
Verified signature9b8c14e