junaidamk
/

ml-bpetokenizer

Model card Files Files and versions

ml-bpetokenizer / tokenizer_config.json

junaidamk's picture

add tokenizer

9e5697e over 4 years ago

Raw History Blame Contribute Delete

46 Bytes

{"tokenizer_class": "PreTrainedTokenizerFast"}