Nanbeige4.3-33B-W4A16-AutoRound / generation_config.json
Tech2wild's picture
W4A16 AutoRound int4 weights
4486412 verified
Raw History Blame Contribute Delete
185 Bytes
{
"_from_model_config": true,
"bos_token_id": 166100,
"do_sample": true,
"eos_token_id": 166101,
"pad_token_id": 0,
"transformers_version": "5.15.0",
"use_cache": false
}