Commit History
-
Regenerate tokenizer.tkz as format v13 (self-contained: added/special tokens stored in-file)
Verified signature052bdc1
-
Upload tokenizer.tkz with huggingface_hub
Verified signatureba4e378
-
Update tokenizer.tkz to v11 (with pad_token_id)
Verified signature6bad8c0