How to use deu05232/promptriever-llama2-7B-RQ1-diff_version_seed12 with PEFT:
from peft import PeftModel from transformers import AutoModel base_model = AutoModel.from_pretrained("meta-llama/Llama-2-7b-hf") model = PeftModel.from_pretrained(base_model, "deu05232/promptriever-llama2-7B-RQ1-diff_version_seed12")
https://huggingface.co/deu05232/promptriever-llama2-7B-RQ1-diff_version_seed12/resolve/main/tokenizer.json
hf download hf://deu05232/promptriever-llama2-7B-RQ1-diff_version_seed12/tokenizer.json
curl -L -o tokenizer.json https://huggingface.co/deu05232/promptriever-llama2-7B-RQ1-diff_version_seed12/resolve/main/tokenizer.json
