How to use hf-internal-testing/tiny-random-FNetForPreTraining with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForPreTraining tokenizer = AutoTokenizer.from_pretrained("hf-internal-testing/tiny-random-FNetForPreTraining") model = AutoModelForPreTraining.from_pretrained("hf-internal-testing/tiny-random-FNetForPreTraining", device_map="auto")
https://huggingface.co/hf-internal-testing/tiny-random-FNetForPreTraining/resolve/c05f55ccfb2f2533babd3c6e99de7749bc8081da/tokenizer.json
hf download hf://hf-internal-testing/tiny-random-FNetForPreTraining@c05f55ccfb2f2533babd3c6e99de7749bc8081da/tokenizer.json
curl -L -o tokenizer.json https://huggingface.co/hf-internal-testing/tiny-random-FNetForPreTraining/resolve/c05f55ccfb2f2533babd3c6e99de7749bc8081da/tokenizer.json
