marin-community
/

marin-tokenizer

Model card Files Files and versions

marin-tokenizer / tokenizer.json

dlwh's picture

Upload tokenizer

37a7a2a verified about 1 year ago

History Blame Contribute Delete

17.2 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )

Xet hash:: 5de30f9b382a76d80a684575cc52cf4acba17b51e87f9dd450ebb96888d1fce4
Size of remote file:: 17.2 MB
SHA256:: 881c9c36c359e1617afef6f7583403567931b7b4f43f6552d2b2155a131650a2

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.