Rumble-2-Flash-8bit / generation_config.json
TheEvil1's picture
Add Rumble-2-Flash converted to MLX with an 8-bit decoder
feb7feb verified
Raw History Blame Contribute Delete
162 Bytes
{
"do_sample": false,
"eos_token_id": [
99562,
99564
],
"max_new_tokens": 512,
"pad_token_id": 99562,
"transformers_version": "5.21.0.dev0"
}