deepseek-ai/DeepSeek-V4-Flash-0731
Text Generation • 304B • Updated • 1.15k
Cross
jreoka
AI & ML interests
AI, anime, computers
Recent Activity
liked a model about 13 hours ago
deepseek-ai/DeepSeek-V4-Flash-0731 reacted to Banaxi-Tech's post with 😎 1 day ago
We're announcing BananaMind 2 Micro, our smallest model in the BananaMind 2 model family.
This model is not released yet, training has not started yet.
It uses only 2.9M parameters, while being overtrained on 75B tokens to get the maximum intelligence per parameter.
The key changes are:
No more AdamW, the model will use the Muon optimizer offering up to 2x faster convergence and higher lr.
LR goes to 2.2e-2.
We're adding the XSA refresh gate from the TX4 architecture into our own.
Training will start on August 3, release date is estimated to be August 4-6.
On August 3 we will also release our Public Preview of BananaMind 2 Pro.
Follow us to know when our models release
https://huggingface.co/BananaMind
@Banaxi-Tech
reacted to Banaxi-Tech's post with 🤗 1 day ago
We're announcing BananaMind 2 Micro, our smallest model in the BananaMind 2 model family.
This model is not released yet, training has not started yet.
It uses only 2.9M parameters, while being overtrained on 75B tokens to get the maximum intelligence per parameter.
The key changes are:
No more AdamW, the model will use the Muon optimizer offering up to 2x faster convergence and higher lr.
LR goes to 2.2e-2.
We're adding the XSA refresh gate from the TX4 architecture into our own.
Training will start on August 3, release date is estimated to be August 4-6.
On August 3 we will also release our Public Preview of BananaMind 2 Pro.
Follow us to know when our models release
https://huggingface.co/BananaMind
@Banaxi-Tech
Organizations
liked a
model about 13 hours ago
reacted to Banaxi-Tech's post with 😎🤗🔥 1 day ago
Post
2715
We're announcing BananaMind 2 Micro, our smallest model in the BananaMind 2 model family.
This model is not released yet, training has not started yet.
It uses only 2.9M parameters, while being overtrained on 75B tokens to get the maximum intelligence per parameter.
The key changes are:
No more AdamW, the model will use the Muon optimizer offering up to 2x faster convergence and higher lr.
LR goes to 2.2e-2.
We're adding the XSA refresh gate from the TX4 architecture into our own.
Training will start on August 3, release date is estimated to be August 4-6.
On August 3 we will also release our Public Preview of BananaMind 2 Pro.
Follow us to know when our models release
BananaMind
@Banaxi-Tech
This model is not released yet, training has not started yet.
It uses only 2.9M parameters, while being overtrained on 75B tokens to get the maximum intelligence per parameter.
The key changes are:
No more AdamW, the model will use the Muon optimizer offering up to 2x faster convergence and higher lr.
LR goes to 2.2e-2.
We're adding the XSA refresh gate from the TX4 architecture into our own.
Training will start on August 3, release date is estimated to be August 4-6.
On August 3 we will also release our Public Preview of BananaMind 2 Pro.
Follow us to know when our models release
@Banaxi-Tech
- 10 replies
liked 4
models 1 day ago
liked a
model 3 days ago
liked 2
models 5 days ago
liked 3
models 8 days ago
THANK YOU!
❤️🚀 19
1
#3 opened 11 days ago
by 
apollo-mg
liked a
model 10 days ago
liked 2
models 12 days ago
liked 2
models 13 days ago
