Download tokenizer_config.json from marid/sst2: direct link, hf CLI and curl.
- Browser
- Download file 300 Bytes
-
https://huggingface.co/marid/sst2/resolve/main/tokenizer_config.json
- Command line
-
hf download hf://marid/sst2/tokenizer_config.json
-
curl -L -o tokenizer_config.json https://huggingface.co/marid/sst2/resolve/main/tokenizer_config.json
300 Bytes
| {"unk_token": "[UNK]", "bos_token": "<s>", "eos_token": "</s>", "pad_token": "[PAD]", "do_lower_case": false, "word_delimiter_token": "|", "special_tokens_map_file": null, "tokenizer_file": null, "name_or_path": "/workspace/cv-corpus-8.0-2022-01-19/output", "tokenizer_class": "Wav2Vec2CTCTokenizer"} |