File size: 182 Bytes
aa0d07a | 1 2 3 4 5 6 7 8 9 | # ClearMind-Base
Trained from scratch with ClearMind. Architecture: GPT (RoPE + RMSNorm + SwiGLU + GQA + QK-Norm).
- Parameters: 68.8M
- Hidden size: 768
- Layers: 8
- Vocab: 6400
|
aa0d07a | 1 2 3 4 5 6 7 8 9 | # ClearMind-Base
Trained from scratch with ClearMind. Architecture: GPT (RoPE + RMSNorm + SwiGLU + GQA + QK-Norm).
- Parameters: 68.8M
- Hidden size: 768
- Layers: 8
- Vocab: 6400
|