How to use santoshtyss/lt5-longbase with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("santoshtyss/lt5-longbase") model = AutoModelForSeq2SeqLM.from_pretrained("santoshtyss/lt5-longbase", device_map="auto")
https://huggingface.co/santoshtyss/lt5-longbase/resolve/main/tokenizer.json
hf download hf://santoshtyss/lt5-longbase/tokenizer.json
curl -L -o tokenizer.json https://huggingface.co/santoshtyss/lt5-longbase/resolve/main/tokenizer.json
