Download quant_meta.json from Azaz666/InternVL2_5-4B-AWQ-INT4: direct link, hf CLI and curl.
- Browser
- Download file 339 Bytes
-
https://huggingface.co/Azaz666/InternVL2_5-4B-AWQ-INT4/resolve/main/quant_meta.json
- Command line
-
hf download hf://Azaz666/InternVL2_5-4B-AWQ-INT4/quant_meta.json
-
curl -L -o quant_meta.json https://huggingface.co/Azaz666/InternVL2_5-4B-AWQ-INT4/resolve/main/quant_meta.json
339 Bytes
| { | |
| "model_id": "OpenGVLab/InternVL2_5-4B", | |
| "family": "internvl25", | |
| "method": "awq_internvl_merge", | |
| "w_bit": 4, | |
| "group_size": 128, | |
| "quant_time_s": 410.5, | |
| "n_calib": 64, | |
| "calib_seq_len": 256, | |
| "notes": "Inner InternLM2 AWQ-quantized, then re-attached to full InternVLChatModel. Vision encoder + mlp1 connector remain FP16." | |
| } |