Xiao-AMD commited on
Commit
e401deb
·
verified ·
1 Parent(s): 0d69595

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -16,7 +16,7 @@ base_model:
16
  - **Inference Engine:** [vLLM](https://docs.vllm.ai/en/latest/)
17
  - **Model Optimizer:** [AMD-Quark](https://quark.docs.amd.com/latest/index.html) (V0.12)
18
  - **Weight quantization:** OCP MXFP4, Static; self_attn Perchannel, FP8E4M3, Static
19
- - **Activation quantization:** OCP MXFP4, Dynamic; self_attn FP8E4M3, per-channel, Dynamic
20
  - **Excluded from quantization:** MoE gates, `lm_head`, vision tower and multimodal projector
21
 
22
  This model was built with the Kimi-K2.7-Code model by applying [AMD-Quark](https://quark.docs.amd.com/latest/index.html) for MXFP4 quantization.
 
16
  - **Inference Engine:** [vLLM](https://docs.vllm.ai/en/latest/)
17
  - **Model Optimizer:** [AMD-Quark](https://quark.docs.amd.com/latest/index.html) (V0.12)
18
  - **Weight quantization:** OCP MXFP4, Static; self_attn Perchannel, FP8E4M3, Static
19
+ - **Activation quantization:** OCP MXFP4, Dynamic; self_attn Pertoken, FP8E4M3, Dynamic
20
  - **Excluded from quantization:** MoE gates, `lm_head`, vision tower and multimodal projector
21
 
22
  This model was built with the Kimi-K2.7-Code model by applying [AMD-Quark](https://quark.docs.amd.com/latest/index.html) for MXFP4 quantization.