Merserk commited on
Commit
cae2a73
·
verified ·
1 Parent(s): 431236b

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -12
README.md CHANGED
@@ -85,7 +85,7 @@ Download the desired `.safetensors` file(s) and place them inside `ComfyUI/model
85
 
86
  ---
87
 
88
- ## Quantization Details & Benchmarks
89
 
90
  ### `qwen3vl_32b_minimax_h3_int4_convrot.safetensors` (`727` tensors)
91
 
@@ -98,17 +98,6 @@ Formatted to MiniMax-H3-Image's exact 50-layer extraction spec (`minimax_h3_te:
98
 
99
  > **Why viewers show `I8` on 4-bit layers:** Safetensors has no native `int4` tensor dtype, so two 4-bit weights are packed per byte in `I8` (`int8`) containers. ComfyUI reads actual 4-bit precision and scales from each layer's `.comfy_quant` and `.weight_scale` tensors.
100
 
101
- ### Verified Benchmark (vs `int8_convrot` on RTX 4060 Ti 16 GB)
102
-
103
- | Metric | `int8_convrot` (`27.14 GB`) | `int4_convrot` (`13.30 GB`) |
104
- | :--- | :---: | :---: |
105
- | **VRAM Peak (Multimodal)** | `14.04 GiB` | **`13.25 GiB`** (`13.20 GiB` text-only) |
106
- | **Encode Latency (Text / MM)** | `23.74 s` / `2.89 s` | **`15.82 s` / `2.14 s`** |
107
- | **50L Text-Only Cosine Sim** | `1.000` (baseline) | **`0.9981`** (`rel_err = 0.0641`) |
108
- | **50L Multimodal Cosine Sim** | `1.000` (baseline) | `0.3600` |
109
-
110
- > *Usage note:* **Text-to-Image** prompts track the INT8 baseline closely (`0.9981` cosine similarity) at under half the disk size. For **multi-reference Image Editing** requiring maximum vision-encoder accuracy, consider a higher-precision variant (`nvfp4_awq` / `w4a8` / `int8_convrot`).
111
-
112
  ### `qwen3.5_9b_int4_convrot.safetensors` (`1,511` tensors)
113
 
114
  Quantized 32-layer **Qwen3.5-9B** multimodal prompt enhancer (`5.42 GB`) using `convrot_w4a4` across language-model, `lm_head`, and compatible vision projections (`gs=256` / `gs=64`), ConvRot `int8_tensorwise` on `embed_tokens` and ViT `mlp.linear_fc2`, and `BF16` norms/biases.
 
85
 
86
  ---
87
 
88
+ ## Quantization Details
89
 
90
  ### `qwen3vl_32b_minimax_h3_int4_convrot.safetensors` (`727` tensors)
91
 
 
98
 
99
  > **Why viewers show `I8` on 4-bit layers:** Safetensors has no native `int4` tensor dtype, so two 4-bit weights are packed per byte in `I8` (`int8`) containers. ComfyUI reads actual 4-bit precision and scales from each layer's `.comfy_quant` and `.weight_scale` tensors.
100
 
 
 
 
 
 
 
 
 
 
 
 
101
  ### `qwen3.5_9b_int4_convrot.safetensors` (`1,511` tensors)
102
 
103
  Quantized 32-layer **Qwen3.5-9B** multimodal prompt enhancer (`5.42 GB`) using `convrot_w4a4` across language-model, `lm_head`, and compatible vision projections (`gs=256` / `gs=64`), ConvRot `int8_tensorwise` on `embed_tokens` and ViT `mlp.linear_fc2`, and `BF16` norms/biases.