Update README.md
Browse files
README.md
CHANGED
|
@@ -66,5 +66,5 @@ Rather than training one model, we trained multiple models, each on a different
|
|
| 66 |
# Results
|
| 67 |
|
| 68 |
| Dataset | Tokens | Final Val Loss β | ARC-Easy β | ARC-Challenge β | HellaSwag β | PIQA β | SWAG β | BLiMP β | Avg β |
|
| 69 |
-
|:-----------------|-------:|-----------:|-----------:|----------------:|------------:|-------:|-------:|--------:|
|
| 70 |
| [FineWeb]() | 500,000,000 | 3.344866 | 27.82% | 22.01% | 26.89% | 52.83% | 30.34% | 65.21% | 37.52% |
|
|
|
|
| 66 |
# Results
|
| 67 |
|
| 68 |
| Dataset | Tokens | Final Val Loss β | ARC-Easy β | ARC-Challenge β | HellaSwag β | PIQA β | SWAG β | BLiMP β | Avg β |
|
| 69 |
+
|:-----------------|-------:|-----------:|-----------:|----------------:|------------:|-------:|-------:|--------:|-------:|
|
| 70 |
| [FineWeb]() | 500,000,000 | 3.344866 | 27.82% | 22.01% | 26.89% | 52.83% | 30.34% | 65.21% | 37.52% |
|