| # ClearMind-Base | |
| Trained from scratch with ClearMind. Architecture: GPT (RoPE + RMSNorm + SwiGLU + GQA + QK-Norm). | |
| - Parameters: 68.8M | |
| - Hidden size: 768 | |
| - Layers: 8 | |
| - Vocab: 6400 | |
| # ClearMind-Base | |
| Trained from scratch with ClearMind. Architecture: GPT (RoPE + RMSNorm + SwiGLU + GQA + QK-Norm). | |
| - Parameters: 68.8M | |
| - Hidden size: 768 | |
| - Layers: 8 | |
| - Vocab: 6400 | |