MyTranslation_300M_Base / special_tokens_map.json
freococo's picture
Release MyTranslation_300M_Base (298.76M inf / 9x RTX 5090, Val PPL 3.20 + custom_code, code & logs)
3bcdbab verified
Raw History Blame Contribute Delete
233 Bytes
{
"unk_token": "<unk>",
"bos_token": "<s>",
"eos_token": "</s>",
"pad_token": "<pad>",
"additional_special_tokens": [
"<2my>",
"<2en>",
"<formal>",
"<spoken>",
"<bt>",
"<denoise>",
"<mask>"
]
}