Instructions to use deepset/tinyroberta-squad2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use deepset/tinyroberta-squad2 with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "question-answering" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # pip install "transformers<5.0.0" from transformers import pipeline pipe = pipeline("question-answering", model="deepset/tinyroberta-squad2")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForQuestionAnswering tokenizer = AutoTokenizer.from_pretrained("deepset/tinyroberta-squad2") model = AutoModelForQuestionAnswering.from_pretrained("deepset/tinyroberta-squad2", device_map="auto") - Inference
- Notebooks
- Google Colab
- Kaggle
Commit 路
53566b5
1
Parent(s): f4e3f5a
Update README.md
Browse files
README.md
CHANGED
|
@@ -33,6 +33,9 @@ temperature = 1.5
|
|
| 33 |
teacher = "deepset/robert-large-squad2"
|
| 34 |
```
|
| 35 |
|
|
|
|
|
|
|
|
|
|
| 36 |
## Performance
|
| 37 |
Evaluated on the SQuAD 2.0 dev set with the [official eval script](https://worksheets.codalab.org/rest/bundles/0x6b567e1cf2e041ec80d7098f031c5c9e/contents/blob/).
|
| 38 |
|
|
|
|
| 33 |
teacher = "deepset/robert-large-squad2"
|
| 34 |
```
|
| 35 |
|
| 36 |
+
## Distillation
|
| 37 |
+
This model was distilled using the approach described in [this paper](https://arxiv.org/pdf/1909.10351.pdf).
|
| 38 |
+
|
| 39 |
## Performance
|
| 40 |
Evaluated on the SQuAD 2.0 dev set with the [official eval script](https://worksheets.codalab.org/rest/bundles/0x6b567e1cf2e041ec80d7098f031c5c9e/contents/blob/).
|
| 41 |
|