Download tokenizer_config.json from junaidamk/ml-wptokenizer: direct link, hf CLI and curl.
- Browser
- Download file 297 Bytes
-
https://huggingface.co/junaidamk/ml-wptokenizer/resolve/main/tokenizer_config.json
- Command line
-
hf download hf://junaidamk/ml-wptokenizer/tokenizer_config.json
-
curl -L -o tokenizer_config.json https://huggingface.co/junaidamk/ml-wptokenizer/resolve/main/tokenizer_config.json
297 Bytes
| {"special_tokens_map_file": "/content/drive/MyDrive/Malayalam-for-tokenizer/Malayalam_tokenizer/my-new-tokenizer-bert/special_tokens_map.json", "name_or_path": "/content/drive/MyDrive/Malayalam-for-tokenizer/Malayalam_tokenizer/my-new-tokenizer-bert", "tokenizer_class": "PreTrainedTokenizerFast"} |