CheckpointAudit-ModelRepo / tokenizer_config.json
toolathlonEval's picture
Upload tokenizer_config.json with huggingface_hub
05b59dd verified
Raw
History Blame Contribute Delete
72 Bytes
{
"model_max_length": 512,
"tokenizer_class": "BertTokenizerFast"
}