Barrrrry
/

DeepSeek-R1-W4AFP8

8-bit precision

Model card Files Files and versions

DeepSeek-R1-W4AFP8 / hf_quant_config.json

Barry Kang

DeepSeek-R1 W4AFP8

fd74c3f over 1 year ago

Raw History Blame Contribute Delete

108 Bytes

	{
	"quantization": {
	"quant_algo": "MIXED_PRECISION",
	"kv_cache_quant_algo": null
	}
	}