Update README.md
Browse files
README.md
CHANGED
|
@@ -14,3 +14,5 @@ tags:
|
|
| 14 |
- **Training Step:** 4000 / 4000
|
| 15 |
- **Current Loss:** 3.5641
|
| 16 |
- **Optimizer:** Hybrid Muon (2D Dense Linears) + AdamW (MoE Nodes, Embeddings)
|
|
|
|
|
|
|
|
|
| 14 |
- **Training Step:** 4000 / 4000
|
| 15 |
- **Current Loss:** 3.5641
|
| 16 |
- **Optimizer:** Hybrid Muon (2D Dense Linears) + AdamW (MoE Nodes, Embeddings)
|
| 17 |
+
|
| 18 |
+

|