Upload README.md
Browse files
README.md
CHANGED
|
@@ -85,7 +85,7 @@ Download the desired `.safetensors` file(s) and place them inside `ComfyUI/model
|
|
| 85 |
|
| 86 |
---
|
| 87 |
|
| 88 |
-
## Quantization Details
|
| 89 |
|
| 90 |
### `qwen3vl_32b_minimax_h3_int4_convrot.safetensors` (`727` tensors)
|
| 91 |
|
|
@@ -98,17 +98,6 @@ Formatted to MiniMax-H3-Image's exact 50-layer extraction spec (`minimax_h3_te:
|
|
| 98 |
|
| 99 |
> **Why viewers show `I8` on 4-bit layers:** Safetensors has no native `int4` tensor dtype, so two 4-bit weights are packed per byte in `I8` (`int8`) containers. ComfyUI reads actual 4-bit precision and scales from each layer's `.comfy_quant` and `.weight_scale` tensors.
|
| 100 |
|
| 101 |
-
### Verified Benchmark (vs `int8_convrot` on RTX 4060 Ti 16 GB)
|
| 102 |
-
|
| 103 |
-
| Metric | `int8_convrot` (`27.14 GB`) | `int4_convrot` (`13.30 GB`) |
|
| 104 |
-
| :--- | :---: | :---: |
|
| 105 |
-
| **VRAM Peak (Multimodal)** | `14.04 GiB` | **`13.25 GiB`** (`13.20 GiB` text-only) |
|
| 106 |
-
| **Encode Latency (Text / MM)** | `23.74 s` / `2.89 s` | **`15.82 s` / `2.14 s`** |
|
| 107 |
-
| **50L Text-Only Cosine Sim** | `1.000` (baseline) | **`0.9981`** (`rel_err = 0.0641`) |
|
| 108 |
-
| **50L Multimodal Cosine Sim** | `1.000` (baseline) | `0.3600` |
|
| 109 |
-
|
| 110 |
-
> *Usage note:* **Text-to-Image** prompts track the INT8 baseline closely (`0.9981` cosine similarity) at under half the disk size. For **multi-reference Image Editing** requiring maximum vision-encoder accuracy, consider a higher-precision variant (`nvfp4_awq` / `w4a8` / `int8_convrot`).
|
| 111 |
-
|
| 112 |
### `qwen3.5_9b_int4_convrot.safetensors` (`1,511` tensors)
|
| 113 |
|
| 114 |
Quantized 32-layer **Qwen3.5-9B** multimodal prompt enhancer (`5.42 GB`) using `convrot_w4a4` across language-model, `lm_head`, and compatible vision projections (`gs=256` / `gs=64`), ConvRot `int8_tensorwise` on `embed_tokens` and ViT `mlp.linear_fc2`, and `BF16` norms/biases.
|
|
|
|
| 85 |
|
| 86 |
---
|
| 87 |
|
| 88 |
+
## Quantization Details
|
| 89 |
|
| 90 |
### `qwen3vl_32b_minimax_h3_int4_convrot.safetensors` (`727` tensors)
|
| 91 |
|
|
|
|
| 98 |
|
| 99 |
> **Why viewers show `I8` on 4-bit layers:** Safetensors has no native `int4` tensor dtype, so two 4-bit weights are packed per byte in `I8` (`int8`) containers. ComfyUI reads actual 4-bit precision and scales from each layer's `.comfy_quant` and `.weight_scale` tensors.
|
| 100 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 101 |
### `qwen3.5_9b_int4_convrot.safetensors` (`1,511` tensors)
|
| 102 |
|
| 103 |
Quantized 32-layer **Qwen3.5-9B** multimodal prompt enhancer (`5.42 GB`) using `convrot_w4a4` across language-model, `lm_head`, and compatible vision projections (`gs=256` / `gs=64`), ConvRot `int8_tensorwise` on `embed_tokens` and ViT `mlp.linear_fc2`, and `BF16` norms/biases.
|