Commit History
-
Add 2MB val text sample for Gemma/HF tokenizer notebooks
Verified signature588ff7f -
Add 20MB raw text sample for Gemma/HF tokenizer notebooks
Verified signatured9422a5
-
Add curated training tokens (266M tokens, Chinchilla-optimal)
Verified signatureab3f5b8 -
Add validation tokens (72M tokens)
Verified signatureff30a4a