ThingAI
/

msqark-tokenizer

Model card Files Files and versions

msqark-tokenizer / tokenizer.json

ThingsAI's picture

BPE tokenizer 32768 vocab with thinking/tool tokens

f862712 verified 3 months ago

2.31 MB

File too large to display, you can check the raw version instead.