How to use VMware/tinyroberta-quantized-mrqa with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("question-answering", model="VMware/tinyroberta-quantized-mrqa")
# Load model directly from transformers import AutoTokenizer, AutoModelForQuestionAnswering tokenizer = AutoTokenizer.from_pretrained("VMware/tinyroberta-quantized-mrqa") model = AutoModelForQuestionAnswering.from_pretrained("VMware/tinyroberta-quantized-mrqa", device_map="auto")
