Katell29/TheseExtraction / special_tokens_map.json
Katell29's picture
download
raw
355 Bytes
{
"additional_special_tokens": [
"<s_iitcdip>",
"<s_synthdog>"
],
"bos_token": "<s>",
"cls_token": "<s>",
"eos_token": "</s>",
"mask_token": {
"content": "<mask>",
"lstrip": true,
"normalized": true,
"rstrip": false,
"single_word": false
},
"pad_token": "<pad>",
"sep_token": "</s>",
"unk_token": "<unk>"
}

Xet Storage Details

Size:
355 Bytes
·
Xet hash:
51d5c4da55a2e3ced98b356acb96ccae2a3688b27b744a224ae23aa520d5bcd7

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.