Model, filtered dataset, code, evaluations and paper for 'Constraining Language Modeling Pretraining Data'
e8fb262 verified | torch>=2.4 | |
| numpy | |
| pyarrow | |
| huggingface_hub | |
| tokenizers | |
| safetensors | |
| transformers | |
| simplemma # only for tools/vocab_filter_estimate.py | |