aliarda
/

turkish_tokenizer_256k

byte-pair-encoding

Model card Files Files and versions

turkish_tokenizer_256k / tokenizer.json

aliarda's picture

Upload tokenizer

a546e4c verified almost 2 years ago

History Blame Contribute Delete

27.4 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )

Xet hash:: 45ce9549ee24ce1111f4cb0f938bdf8f118bc689a040dcbee5b8250e801195fd
Size of remote file:: 27.4 MB
SHA256:: 08639716769371dd77ff29bc312a5a8c225d6c9c2aad7e69fd3ef7510e4429e8

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.