AI & ML interests

None defined yet.

hitradostava 
posted an update about 2 years ago
view post
Post
1,147
Hey, we've been researching how sentiment analysis models work on real world data and would like to share a comparison tool and leaderboard that we've built: https://addmaple.com/sentiment

Compare 12 models - top RoBERTa models, plus Google/AWS commercial offerings and GPT4o.

Rather than just a score, you can explore results by those with the highest disagreement between models, which gives a nice intuition for the strengths and weaknesses of each model.

For example a genuine restaurant review is: "Food doesn’t get better than this. I was sad when I finished, actually sad. To die for." - https://addmaple.com/sentiment/public-reviews/manteca/C9bvMuyAeF1g

SiEBERT gets it right, as do Google and OpenAI but all other models fail.

We'd love your feedback

Hitra