Pravincoder/all-mpnet-base-v2-bucket / tokenizer_config.json
Pravincoder's picture
download
raw
363 Bytes
{"do_lower_case": true, "bos_token": "<s>", "eos_token": "</s>", "sep_token": "</s>", "cls_token": "<s>", "unk_token": "[UNK]", "pad_token": "<pad>", "mask_token": "<mask>", "tokenize_chinese_chars": true, "strip_accents": null, "model_max_length": 512, "special_tokens_map_file": null, "name_or_path": "microsoft/mpnet-base", "tokenizer_class": "MPNetTokenizer"}

Xet Storage Details

Size:
363 Bytes
·
Xet hash:
18ae066a2460228fe9b7b6d44dfd214748c6ea7f51a2138c69ce94c6116e5775

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.