GLM-4.7-Flash-abliterated-FP8-Dynamic / generation_config.json
mlavkin's picture
Add FP8 W8A8 dynamic quant of Huihui-GLM-4.7-Flash-abliterated
ad83565 verified
Raw History Blame Contribute Delete
177 Bytes
{
"_from_model_config": true,
"eos_token_id": [
154820,
154827,
154829
],
"pad_token_id": 154820,
"temperature": 1.0,
"transformers_version": "5.14.1"
}