How to use NeuronTechnologiesAI/Neuron with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("/workspace/models/Qwen2.5-72B-Instruct") model = PeftModel.from_pretrained(base_model, "NeuronTechnologiesAI/Neuron")
https://huggingface.co/NeuronTechnologiesAI/Neuron/resolve/main/checkpoint-200/merges.txt
hf download hf://NeuronTechnologiesAI/Neuron/checkpoint-200/merges.txt
curl -L -o merges.txt https://huggingface.co/NeuronTechnologiesAI/Neuron/resolve/main/checkpoint-200/merges.txt
