rajpurkar/squad
Viewer • Updated • 98.2k • 152k • 892
How to use sasuke/distilbert-base-uncased-finetuned-squad with Transformers:
# Use a pipeline as a high-level helper
# Warning: Pipeline type "question-answering" is no longer supported in transformers v5.
# You must load the model directly (see below) or downgrade to v4.x with:
# pip install "transformers<5.0.0"
from transformers import pipeline
pipe = pipeline("question-answering", model="sasuke/distilbert-base-uncased-finetuned-squad") # pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForQuestionAnswering
tokenizer = AutoTokenizer.from_pretrained("sasuke/distilbert-base-uncased-finetuned-squad")
model = AutoModelForQuestionAnswering.from_pretrained("sasuke/distilbert-base-uncased-finetuned-squad", device_map="auto")This model is a fine-tuned version of distilbert-base-uncased on the squad dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| 1.2997 | 1.0 | 2767 | 1.1918 |
| 1.0491 | 2.0 | 5534 | 1.1328 |
| 0.8768 | 3.0 | 8301 | 1.1458 |