How to use NewT5SharedHeadsSharedKeyValues/t5-efficient-tiny-sh with Transformers:
# Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("NewT5SharedHeadsSharedKeyValues/t5-efficient-tiny-sh") model = AutoModelForSeq2SeqLM.from_pretrained("NewT5SharedHeadsSharedKeyValues/t5-efficient-tiny-sh", device_map="auto")
tags: - t5-new-failed
Hf T5: -149.6728801727295 MTF T5: -74.4166259765625
