How to use ciphermosaic/phi-3.5-oasst1 with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("microsoft/Phi-3.5-mini-instruct") model = PeftModel.from_pretrained(base_model, "ciphermosaic/phi-3.5-oasst1")
How to use ciphermosaic/phi-3.5-oasst1 with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("ciphermosaic/phi-3.5-oasst1", device_map="auto")
https://huggingface.co/ciphermosaic/phi-3.5-oasst1/resolve/main/tokenizer.json
hf download hf://ciphermosaic/phi-3.5-oasst1/tokenizer.json
curl -L -o tokenizer.json https://huggingface.co/ciphermosaic/phi-3.5-oasst1/resolve/main/tokenizer.json
