Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
hitradostava 
posted an update Oct 21, 2024
Post
1,147
Hey, we've been researching how sentiment analysis models work on real world data and would like to share a comparison tool and leaderboard that we've built: https://addmaple.com/sentiment

Compare 12 models - top RoBERTa models, plus Google/AWS commercial offerings and GPT4o.

Rather than just a score, you can explore results by those with the highest disagreement between models, which gives a nice intuition for the strengths and weaknesses of each model.

For example a genuine restaurant review is: "Food doesn’t get better than this. I was sad when I finished, actually sad. To die for." - https://addmaple.com/sentiment/public-reviews/manteca/C9bvMuyAeF1g

SiEBERT gets it right, as do Google and OpenAI but all other models fail.

We'd love your feedback

Hitra


In this post