marin-community
/

marin-tokenizer-tools

Model card Files Files and versions

marin-tokenizer-tools / tokenizer.json

WillHeld's picture

Publish Marin tokenizer with tool call delimiters

3f6879a verified about 2 months ago

History Blame Contribute Delete

17.2 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )

Xet hash:: 071f8af21cb56d17126f8a1943ec61afcd8c05a3d934aaab9e3b53e4b36f1809
Size of remote file:: 17.2 MB
SHA256:: 6a61ca2105a54e9984169b409581f31cc50330d1b47104af13c221b05e462e45

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.