How to use rewicks/baseline_en-de_32k_ep39 with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("rewicks/baseline_en-de_32k_ep39") model = AutoModelForSeq2SeqLM.from_pretrained("rewicks/baseline_en-de_32k_ep39", device_map="auto")
https://huggingface.co/rewicks/baseline_en-de_32k_ep39/resolve/main/source.spm
hf download hf://rewicks/baseline_en-de_32k_ep39/source.spm
curl -L -o source.spm https://huggingface.co/rewicks/baseline_en-de_32k_ep39/resolve/main/source.spm
