Update README.md
Browse files
README.md
CHANGED
|
@@ -8,7 +8,7 @@ Note: AI was used in the creation of this project. But that's why you're here, i
|
|
| 8 |
This is the base model for VegaLM1-42M, an experimental SLM trained on various corpi... corpuses... datasets.
|
| 9 |
It's not Fable 6, but it's good enough, ok?
|
| 10 |
|
| 11 |
-
Evals for the
|
| 12 |
- BananaMind Base Bench 1.1: 132/350 (37.71%), Elo 912.8, roughly on par with 10M models
|
| 13 |
|
| 14 |
-
The first
|
|
|
|
| 8 |
This is the base model for VegaLM1-42M, an experimental SLM trained on various corpi... corpuses... datasets.
|
| 9 |
It's not Fable 6, but it's good enough, ok?
|
| 10 |
|
| 11 |
+
Evals for the 235M tok checkpoint:
|
| 12 |
- BananaMind Base Bench 1.1: 132/350 (37.71%), Elo 912.8, roughly on par with 10M models
|
| 13 |
|
| 14 |
+
The first 235M tokens the model saw came from a 90M selection of fineweb-edu
|