Palash123
/

indic_128K_tokenizer

Model card Files Files and versions

indic_128K_tokenizer / tokenizer.model

Palash123's picture

Upload tokenizer

b373785 verified over 2 years ago

History Blame Contribute Delete

2.87 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )

Xet hash:: 12b41d248083950e43f86f15b26c12ce10bce415bce56e6583a8f59f467a76f8
Size of remote file:: 2.87 MB
SHA256:: 389a98f06d5afc3be632ff7de9825b1029a137ed1e4a82b0d1cb82a7814e7c0e

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.