Post
111
Hi! We're right now experimenting with so many new architectures!
We are also going to release BananaMind Gate Attention very soon, its a new attention that can make attention 128x cheaper at 1M Context! Check my account for HF blogs it will release there!
We are also going to release BananaMind Gate Attention very soon, its a new attention that can make attention 128x cheaper at 1M Context! Check my account for HF blogs it will release there!
