model-update-poc / tokenizer_config.json
sohamsathe's picture
Add initial test model files - Version 2
20cd3a0 verified
Raw History Blame Contribute Delete
95 Bytes
{
"tokenizer_class": "TestTokenizer",
"model_max_length": 512,
"padding_side": "right"
}