mmx86
/

tiny-model

Model card Files Files and versions

tiny-model / tokenizer_config.json

mmx86's picture

Upload 6 files

05121e9 verified about 1 year ago

Raw History Blame Contribute Delete

125 Bytes

{"tokenizer_class": "ConstantTokenizer", "bos_token": "<s>", "eos_token": "</s>", "unk_token": "<unk>", "pad_token": "<pad>"}