Flint-GPTQ-INT8-PTQR / quantize_config.json
curvedinf's picture
Add files using upload-large-folder tool
37bf973 verified
Raw History Blame Contribute Delete
286 Bytes
{
"bits": 8,
"group_size": 128,
"desc_act": false,
"sym": true,
"lm_head": false,
"method": "gptq",
"quant_method": "gptq",
"checkpoint_format": "gptq",
"pack_dtype": "int32",
"meta": {
"quantizer": [
"ptqr-retrain:scripts/ptqr_export_flint.py"
]
}
}