SpearsoftLabs
/

spearindic-tokenizer

Model card Files Files and versions

spearindic-tokenizer / tokenizer.json

Srish117's picture

SpearIndic v2: 22 languages, Unigram 200k/128k, full script coverage, ablation models

8570306 verified 4 days ago

History Blame Contribute Delete

14.5 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )

Xet hash:: d9630396ca2d9fde340ac16172fdd1187f08e480494736d3bc8795a2bb99eabc
Size of remote file:: 14.5 MB
SHA256:: 9e06688be425d0f26946c744a11ef5c1867e835beedf5c6b4acae0727f65747f

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.