Post
2774
Hi everyone!
We've seen some people getting confused with the BananaMind Leaderboards so ill explain!
We have 2 leaderboards, THESE are NOT the same, first BananaMind/BananaMindBench-Leaderboard which is ONLY for BananaMind Base Bench 1.1. The 10/10 scores do NOT mean that the benchmark is saturated. It isnt saturated, these models score 10/10 because they are the current best models, our /10 ranking system works by taking the ELO scores and then comparing them to the scores in the same size range. So if a better model releases that gets 10/10 and the others get lower.
And we also have the BananaMind SLM leaderboard, not the BananaMindBench leaderboard which uses ARC EASY,PIQA,Hellaswag, Arithmark 3 and the BananaMind Base Bench 1.1. This is the newer and recommended version.
Hope you understand it now!
cODeQ
We've seen some people getting confused with the BananaMind Leaderboards so ill explain!
We have 2 leaderboards, THESE are NOT the same, first BananaMind/BananaMindBench-Leaderboard which is ONLY for BananaMind Base Bench 1.1. The 10/10 scores do NOT mean that the benchmark is saturated. It isnt saturated, these models score 10/10 because they are the current best models, our /10 ranking system works by taking the ELO scores and then comparing them to the scores in the same size range. So if a better model releases that gets 10/10 and the others get lower.
And we also have the BananaMind SLM leaderboard, not the BananaMindBench leaderboard which uses ARC EASY,PIQA,Hellaswag, Arithmark 3 and the BananaMind Base Bench 1.1. This is the newer and recommended version.
Hope you understand it now!
cODeQ
