How to use stas/mt5-tiny-random with Transformers:
# Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("stas/mt5-tiny-random") model = AutoModelForSeq2SeqLM.from_pretrained("stas/mt5-tiny-random", device_map="auto")
This is a tiny random mt5 model used for testing
See mt5-make-tiny-model.py for how it was created.
mt5-make-tiny-model.py
