Mental-BERT

Multi-label emotion classifier trained on depression-related text.

  • Base model: mental/mental-bert-base-uncased
  • Architecture: Standard AutoModelForSequenceClassification
  • Labels (8): anger, brain dysfunction (forget), emptiness, hopelessness, loneliness, sadness, suicide intent, worthlessness
  • Seed: 42, Epochs: 5, LR: 2e-05, MaxLen: 256

Test metrics

{
  "eval_loss": 0.7400534152984619,
  "eval_P-Mic": 0.8302808302808303,
  "eval_R-Mic": 0.8131539611360239,
  "eval_F1-Mic": 0.821628152847002,
  "eval_P-Mac": 0.807825879727939,
  "eval_R-Mac": 0.7503261107967976,
  "eval_F1-Mac": 0.7611895441964418
}
Downloads last month
111
Safetensors
Model size
0.1B params
Tensor type
F32
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support