BA BIC BDA - Serloth-Schwarzer 2024
Collection
3 items โข Updated
How to use mserloth/v21 with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("text-classification", model="mserloth/v21") # pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForSequenceClassification
tokenizer = AutoTokenizer.from_pretrained("mserloth/v21")
model = AutoModelForSequenceClassification.from_pretrained("mserloth/v21", device_map="auto")loss: 0.5896586775779724
f1_macro: 0.6544353292567254
f1_micro: 0.707936507936508
f1_weighted: 0.693246083160111
precision_macro: 0.7424193199047
precision_micro: 0.707936507936508
precision_weighted: 0.7052234495704283
recall_macro: 0.6125864829753165
recall_micro: 0.707936507936508
recall_weighted: 0.707936507936508
accuracy: 0.707936507936508