Hugging Face's logo

fromziro
/
DataBench

Safetensors
English
ablations
datasets
1m
llama
custom_tokenizer
Model card Files
xet
 Community
Harley-ml commited on
Commit
4b08ac5
·
verified ·
1 Parent(s): 79c0f84

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -2
README.md CHANGED
@@ -65,5 +65,6 @@ Rather than training one model, we trained multiple models, each on a different
65
 
66
  # Results
67
 
68
- | Dataset | Tokens | Final Val Loss | ARC Easy | ARC Challenge | HellaSwag | PiQA | SWAG | BLiMP |
69
- |:--------|-------:|---------------:|---------:|--------------:|----------:|-----:|-----:|------:|
 
 
65
 
66
  # Results
67
 
68
+ | Dataset | Tokens | Val Loss ↓ | ARC-Easy ↑ | ARC-Challenge ↑ | HellaSwag ↑ | PIQA `↑ | SWAG ↑ | BLiMP ↑ |
69
+ |:-----------------|-------:|-----------:|-----------:|----------------:|------------:|-------:|-------:|--------:|
70
+ | [Project Gutenberg](https://huggingface.co/common-pile/project_gutenberg_filtered) | 499,863,368 | 2.9309 | 25.95% | 24.91% | 24.79% | 50.22% | 27.00% | 63.76% |