Regenerate tokenizer.tkz as format v13 (self-contained: added/special tokens stored in-file)
9fe7095 verified - Xet hash:
- 3c320fce969766041dc0049ccdf32ae03360c95cdee00c5f31c39db9821db120
- Size of remote file:
- 3.3 MB
- SHA256:
- a55d7c9a5aae8774f79fdafc08103a0833f4e308cd4c567f2902371db5c71971
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.