YuE2-3B-Diffusers / tokenizer /tokenizer_config.json
OzzyGT's picture
OzzyGT HF Staff
Upload 12 files
7b4c0bf verified
Raw History Blame Contribute Delete
182 Bytes
{
"added_tokens_decoder": {},
"backend": "custom",
"expected_vocab_size": 151643,
"model_max_length": 1000000000000000019884624838656,
"tokenizer_class": "YuE2Tokenizer"
}