Download tokenizer_config.json from Genn9508/Gaz: direct link, hf CLI and curl.
- Browser
- Download file 279 Bytes
-
https://huggingface.co/Genn9508/Gaz/resolve/main/tokenizer_config.json
- Command line
-
hf download hf://Genn9508/Gaz/tokenizer_config.json
-
curl -L -o tokenizer_config.json https://huggingface.co/Genn9508/Gaz/resolve/main/tokenizer_config.json
279 Bytes
| {"eos_token": "</s>", "unk_token": "<unk>", "pad_token": "<pad>", "extra_ids": 0, "additional_special_tokens": null, "special_tokens_map_file": "rut5-base/special_tokens_map.json", "name_or_path": "cointegrated/rut5-base", "sp_model_kwargs": {}, "tokenizer_class": "T5Tokenizer"} |