You need to agree to share your Hugging Face information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

Log in or Sign Up to review the conditions and access this model content.

Model Details

Model Description

The NusaBERT-base-Indonesian-Plutchik-emotion-analysis-v2 is a model designed to identify and analyze emotions in Indonesian texts based on Plutchik's eight basic emotions: Anticipation, Anger, Disgust, Fear, Joy, Sadness, Surprise, and Trust. This model is developed using the NusaBERT-base and trained using Indonesian tweets categorized into eight emotion categories. The evaluation results of this model can be utilized to analyze emotions in social media, providing insights into users' emotional responses.

Bias

Keep in mind that this model is trained using certain data which may cause bias in the emotion classification process. Therefore, it is important to consider and account for such biases when using this model.

Evaluation Results

The model was trained using the Hyperparameter Tuning technique with Optuna. In this process, Optuna conducted five trials to determine the optimal combination of learning rate (1e-6 to 1e-4) and weight decay (1e-6 to 1e-2). Each trial trained the BERT model with different hyperparameter configurations on the training dataset and then evaluated using the validation dataset. After all the experiments are completed, the best hyperparameter combination is used to train the final model.

Epoch Training Loss Validation Loss Accuracy F1 Precision Recall
1 0.758400 0.583508 0.829932 0.830203 0.833136 0.829932
2 0.370100 0.394630 0.866213 0.865496 0.870364 0.866213
3 0.231500 0.355294 0.884354 0.884585 0.888140 0.884354
4 0.071000 0.322376 0.902494 0.902801 0.904842 0.902494
5 0.129900 0.308596 0.900227 0.900340 0.902132 0.900227
Downloads last month
-
Safetensors
Model size
0.1B params
Tensor type
F32
ยท
Inference Examples
Examples
Sadness
0.604
Anger
0.194
Surprise
0.127
Joy
0.021
Fear
0.018
Disgust
0.018
Anticipation
0.016
Trust
0.003
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support