24b1064-Week08-Compression-20-Submission01 / quantization_config.json
sDarth's picture
Upload folder using huggingface_hub
af04b83 verified
Raw History Blame Contribute Delete
351 Bytes
{
"bits": 3,
"data_type": "int",
"group_size": 128,
"sym": true,
"enable_norm_bias_tuning": true,
"gradient_accumulate_steps": 8,
"low_gpu_mem_usage": true,
"autoround_version": "0.16.0",
"lm_head": false,
"provider": "auto-round",
"quant_method": "gptq",
"desc_act": false,
"true_sequential": false,
"damp_percent": 0.01
}