How to use augustocsc/gpt2_base_prefix_682k with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("gpt2") model = PeftModel.from_pretrained(base_model, "augustocsc/gpt2_base_prefix_682k")
https://huggingface.co/augustocsc/gpt2_base_prefix_682k/resolve/main/scripts/preprocess_data.py
hf download hf://augustocsc/gpt2_base_prefix_682k/scripts/preprocess_data.py
curl -L -o preprocess_data.py https://huggingface.co/augustocsc/gpt2_base_prefix_682k/resolve/main/scripts/preprocess_data.py
