flexitok
/

parity-aware-bpe-devset

Model card Files Files and versions

parity-aware-bpe-devset / tokenizer.json

gsaltintas's picture

Upload tokenizer

dd6a333 verified 5 days ago

History Blame Contribute Delete

10.5 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )

Xet hash:: 9230be694df4aa6331797e44c0c2aafcdbeec11dc9738888bda11917da6e63c9
Size of remote file:: 10.5 MB
SHA256:: 3ee8d08a790d98cd94a7c5ade43912e30ca0dcc20b05884a5e4e59745f40de16

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.