base2 / tokenizer_config.json
gszabo's picture
Upload tokenizer
4a830b4
Raw History Blame Contribute Delete
51 Bytes
{
"tokenizer_class": "PreTrainedTokenizerFast"
}