gemma-4-e4b-it-fp8 / hf_quant_config.json
mrysh's picture
fp8 checkpoint of google/gemma-4-E4B-it
0c7bb58 verified
Raw History Blame Contribute Delete
309 Bytes
{
"producer": {
"name": "modelopt",
"version": "0.47.0"
},
"quantization": {
"quant_algo": "FP8",
"kv_cache_quant_algo": null,
"exclude_modules": [
"lm_head",
"model.embed_vision*",
"model.vision_tower*"
]
}
}