KOS-V5.1-Instruct / tokenizer_config.json
codybum's picture
KOS-V5.1-Instruct: config fix (top-level rope_theta 25000) + MLP task-arithmetic edit of KOS-V5-Instruct 7188bdc8
98d753a verified
Raw History Blame Contribute Delete
247 Bytes
{
"bos_token": null,
"eos_token": "<|im_end|>",
"model_max_length": 32768,
"pad_token": "<|im_end|>",
"padding_side": "right",
"split_special_tokens": false,
"tokenizer_class": "PreTrainedTokenizerFast",
"unk_token": "<|im_end|>"
}