temp / added_tokens.json
michaelRussoIII's picture
Upload tokenizer
54e464b verified
Raw History Blame Contribute Delete
21 Bytes
{
"[PAD]": 32000
}