How to use Shaier/longformer_cosmos with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForMultipleChoice tokenizer = AutoTokenizer.from_pretrained("Shaier/longformer_cosmos") model = AutoModelForMultipleChoice.from_pretrained("Shaier/longformer_cosmos", device_map="auto")
https://huggingface.co/Shaier/longformer_cosmos/resolve/main/tokenizer.json
hf download hf://Shaier/longformer_cosmos/tokenizer.json
curl -L -o tokenizer.json https://huggingface.co/Shaier/longformer_cosmos/resolve/main/tokenizer.json
