cache / added_tokens.json
Andy Zhou
Upload tokenizer
e4f65da verified
Raw History Blame Contribute Delete
71 Bytes
{
"<sep>": 32002,
"<|end_of_turn|>": 32000,
"<|pad_0|>": 32001
}