Post
6159
Hey everyone! I got sidetracked from my main projects and decided to test out the BananaAll app and see if I could make a small model not regress too much during SFT. Here is what happened:
The base model I chose was BananaMind/BananaMind-2.1-Pico-Preview, and the dataset I used was SupraLabs/SupraThink-Dataset-500x
I trained for 5 whole steps using a LoRA adapter.
Results:
A model that scores better on some benchmarks and worse on others, and still lacks most general capabilities.
You can find the model here: Hoglet-33/Hogleto
Credits:
- Thank you to @Banaxi-Tech for the BananaAll app (works perfectly on Windows and CPU)
- GPT-6 Sol for knowing how to merge some confusing files created by the app
- Myself for the idea
- Someone else somewhere who might have contributed to some of my ideas and might in the future
- And readers like you!
The base model I chose was BananaMind/BananaMind-2.1-Pico-Preview, and the dataset I used was SupraLabs/SupraThink-Dataset-500x
I trained for 5 whole steps using a LoRA adapter.
Results:
A model that scores better on some benchmarks and worse on others, and still lacks most general capabilities.
You can find the model here: Hoglet-33/Hogleto
Credits:
- Thank you to @Banaxi-Tech for the BananaAll app (works perfectly on Windows and CPU)
- GPT-6 Sol for knowing how to merge some confusing files created by the app
- Myself for the idea
- Someone else somewhere who might have contributed to some of my ideas and might in the future
- And readers like you!
- 6 replies
