Download special_tokens_map.json from mbateman/code-search-net-tokenizer: direct link, hf CLI and curl.
- Browser
- Download file 90 Bytes
-
https://huggingface.co/mbateman/code-search-net-tokenizer/resolve/main/special_tokens_map.json
- Command line
-
hf download hf://mbateman/code-search-net-tokenizer/special_tokens_map.json
-
curl -L -o special_tokens_map.json https://huggingface.co/mbateman/code-search-net-tokenizer/resolve/main/special_tokens_map.json
90 Bytes
| {"bos_token": "<|endoftext|>", "eos_token": "<|endoftext|>", "unk_token": "<|endoftext|>"} |