TFG
Collection
Datasets and models leveraged and developed during my final degree work (TFG). Info and code can be found at https://github.com/enriquesaou/tfg-lm-qa • 18 items • Updated • 2
How to use enriquesaou/roberta-mrqa with Transformers:
# Use a pipeline as a high-level helper
# Warning: Pipeline type "question-answering" is no longer supported in transformers v5.
# You must load the model directly (see below) or downgrade to v4.x with:
# pip install "transformers<5.0.0"
from transformers import pipeline
pipe = pipeline("question-answering", model="enriquesaou/roberta-mrqa") # pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForQuestionAnswering
tokenizer = AutoTokenizer.from_pretrained("enriquesaou/roberta-mrqa")
model = AutoModelForQuestionAnswering.from_pretrained("enriquesaou/roberta-mrqa", device_map="auto")# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForQuestionAnswering
tokenizer = AutoTokenizer.from_pretrained("enriquesaou/roberta-mrqa")
model = AutoModelForQuestionAnswering.from_pretrained("enriquesaou/roberta-mrqa", device_map="auto")This model is a fine-tuned version of FacebookAI/roberta-base on an unknown dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| 1.7637 | 1.0 | 1399 | 1.5842 |
| 1.3627 | 2.0 | 2798 | 1.6059 |
| 1.1236 | 3.0 | 4197 | 1.6199 |
Base model
FacebookAI/roberta-base
# Use a pipeline as a high-level helper # Warning: Pipeline type "question-answering" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # pip install "transformers<5.0.0" from transformers import pipeline pipe = pipeline("question-answering", model="enriquesaou/roberta-mrqa")