ehovy/race
Viewer โข Updated โข 195k โข 28k โข 76
How to use augmdc/bigbird_race_1 with Transformers:
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForMultipleChoice
tokenizer = AutoTokenizer.from_pretrained("augmdc/bigbird_race_1")
model = AutoModelForMultipleChoice.from_pretrained("augmdc/bigbird_race_1", device_map="auto")This model is a fine-tuned version of google/bigbird-roberta-base on the race dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|---|---|---|---|---|
| 1.313 | 1.0 | 1589 | 1.2015 | 0.4896 |
| 1.0197 | 2.0 | 3178 | 1.0178 | 0.5884 |