How to use hf-internal-testing/tiny-random-BigBirdForPreTraining with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForPreTraining tokenizer = AutoTokenizer.from_pretrained("hf-internal-testing/tiny-random-BigBirdForPreTraining") model = AutoModelForPreTraining.from_pretrained("hf-internal-testing/tiny-random-BigBirdForPreTraining", device_map="auto")
https://huggingface.co/hf-internal-testing/tiny-random-BigBirdForPreTraining/resolve/7261f96287c43f32909ffd7f126d51340a68ca26/tokenizer.json
hf download hf://hf-internal-testing/tiny-random-BigBirdForPreTraining@7261f96287c43f32909ffd7f126d51340a68ca26/tokenizer.json
curl -L -o tokenizer.json https://huggingface.co/hf-internal-testing/tiny-random-BigBirdForPreTraining/resolve/7261f96287c43f32909ffd7f126d51340a68ca26/tokenizer.json
