BA BIC BDA - Serloth-Schwarzer 2024
Collection
3 items โข Updated
How to use mserloth/v20 with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("text-classification", model="mserloth/v20") # pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForSequenceClassification
tokenizer = AutoTokenizer.from_pretrained("mserloth/v20")
model = AutoModelForSequenceClassification.from_pretrained("mserloth/v20", device_map="auto")loss: 0.6413357257843018
f1_macro: 0.7163881004940608
f1_micro: 0.725925925925926
f1_weighted: 0.7259726456194447
precision_macro: 0.6712302319912927
precision_micro: 0.725925925925926
precision_weighted: 0.7310670226564031
recall_macro: 0.8041251807057194
recall_micro: 0.725925925925926
recall_weighted: 0.725925925925926
accuracy: 0.725925925925926