devngho
/

phi4-jamo-tokenizer

Model card Files Files and versions

phi4-jamo-tokenizer / tokenizer.json

devngho's picture

Fix bos token

ecbdfb8 verified over 1 year ago

History Blame Contribute Delete

11.3 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )

Xet hash:: 0c967d82c6ea7805f32030480c8cb770db9fd384649961dbd05ca579650ab079
Size of remote file:: 11.3 MB
SHA256:: b535a26b9b09cb661b5642a9ddffbb577d45cb1bf872e3039b975d6b67a16ed6

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.