junaidamk
/

ml-tokenizer

Model card Files Files and versions

ml-tokenizer / tokenizer_config.json

junaidamk's picture

add tokenizer

4492408 over 4 years ago

Raw History Blame Contribute Delete

46 Bytes

{"tokenizer_class": "PreTrainedTokenizerFast"}