clairic-4bit / generation_config.json
lucataco's picture
Clairic, MLX 4-bit, with runtime, server and conversion script
1a48d6b verified
Raw History Blame Contribute Delete
156 Bytes
{
"bos_token_id": 248044,
"do_sample": true,
"eos_token_id": 248046,
"pad_token_id": 248044,
"temperature": 1.0,
"top_k": 20,
"top_p": 0.95
}