En_shuffle_control / tokenizer_config.json
Abathar's picture
Upload tokenizer_config.json with huggingface_hub
e4fd8d3 verified
Raw History Blame Contribute Delete
43 Bytes
{"tokenizer_class": "PassthroughTokenizer"}