iconic / tokenizer.json
gotugotu's picture
Smaller tokenizer, link SDKs
773ef2a verified
History Blame Contribute Delete
1.43 MB
This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )
Xet hash:
64a0177d89ef89ef739b1e3ecf2b363639c56dd8de01d5e6c942891bfe17d458
Size of remote file:
1.43 MB
·
SHA256:
5aa30b9cc0ce56bb1ce75312ab6b68950cc8ce81f99c434daebc4439cf392672

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.