We're excited to release BananaMind Base Bench 1.1 A new benchmark for base language models with 350 text-completion examples across seven categories. Models are scored using continuation likelihood and receive an Overall Elo score. Initial results: BananaMind-2-Medium: 1034 BananaMind-2-Mini: 974 Supra-50M-Base: 973 Supra-1.5-50M-Base-exp: 948 BananaMind-2-Nano: 910 The official script downloads the gated dataset directly from Hugging Face. The dataset is for benchmarking only and may not be used for model training. BananaMind/BananaMind-Base-Bench-1.1
We are announcing 3 more models in our BananaMind 2 Family of models! BananaMind 2 Nano, a small 10M parameter model, fits on your Pentium 4 BananaMind 2 Medium, our medium model, 50M parameters BananaMind 2 MoE, 25M parameters, 2M active per tokens as fast as a 2M.
Because of this our release dates have changed a bit our currently estimates are: BananaMind 2 MoE July 16-18 BananaMind 2 Nano July 18-20 BananaMind 2 Medium July 24-28 BananaMind 2 Pro August 10-16 Keep in mind these dates are estimates and we don't have a speed number currently, we will post for details going forward!