TeamAIQ's picture
Add configs and tokenizer files
a0da392 verified
Raw History Blame Contribute Delete
193 Bytes
{
"quantization_method": "int8_per_channel_symmetric",
"skip_patterns": [
"final_layer.linear"
],
"description": "Weight-only INT8 quantization with per-channel symmetric scaling"
}