Heimrih
/

code-tokenizer-0526

code-tokenizer-0526 / special_tokens_map.json

Upload tokenizer

cb6daee verified over 1 year ago

51 Bytes

{
  "pad_token": "<pad>",
  "unk_token": "<unk>"
}