Harley-ml commited on
Commit
9c1a1f8
Β·
verified Β·
1 Parent(s): 6735bb6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -3
README.md CHANGED
@@ -65,6 +65,7 @@ Rather than training one model, we trained multiple models, each on a different
65
 
66
  # Results
67
 
68
- | Dataset | Tokens | Final Val Loss ↓ | ARC-Easy ↑ | ARC-Challenge ↑ | HellaSwag ↑ | PIQA ↑ | SWAG ↑ | BLiMP ↑ | Avg ↑ |
69
- |:-----------------|-------:|-----------:|-----------:|----------------:|------------:|-------:|-------:|--------:|-------:|
70
- | [FineWeb](https://huggingface.co/HuggingFaceFW/fineweb) | 500,000,000 | 3.344866 | 27.82% | 22.01% | 26.89% | 52.83% | 30.34% | 65.21% | 37.52% |
 
 
65
 
66
  # Results
67
 
68
+ | Dataset | ARC-Easy ↑ | ARC-Challenge ↑ | HellaSwag ↑ | PIQA ↑ | SWAG ↑ | BLiMP ↑ | Avg ↑ |
69
+ |:-----------------|-----------:|----------------:|------------:|-------:|-------:|--------:|-------:|
70
+ | [FineWeb](https://huggingface.co/HuggingFaceFW/fineweb) | 27.82% | 22.01% | 26.89% | 52.83% | 30.34% | 65.21% | 37.52% |
71
+ | [DCLM-1.0-Baseline]() | 29.08% | 22.41% | 27.06% | 52.23% | 31.00% | 66.16% | 37.99% |