Document fl2va_pruned_nvfp4
Browse files
README.md
CHANGED
|
@@ -14,7 +14,8 @@ base_model_relation: quantized
|
|
| 14 |
|
| 15 |
# MiniMax H3 β NVFP4
|
| 16 |
|
| 17 |
-
NVFP4 quantizations of the **MiniMax-H3**
|
|
|
|
| 18 |
|
| 19 |
- Original model: https://huggingface.co/MiniMaxAI/MiniMax-H3
|
| 20 |
- ComfyUI repackage these derive from: https://huggingface.co/Comfy-Org/MiniMax-H3
|
|
@@ -24,15 +25,26 @@ Hopper or older the NVFP4 path is emulated β use Comfy-Org's `int8_convrot` fi
|
|
| 24 |
|
| 25 |
## Which file do I want?
|
| 26 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 27 |
| file | size | s/it | VRAM (DiT) | notes |
|
| 28 |
|---|---|---|---|---|
|
| 29 |
-
| **`minimax_h3_ref2va_pruned_nvfp4.safetensors`** | **12.5 GB** | **1.90** | 11.9 GB | **recommended** |
|
|
|
|
| 30 |
| `minimax_h3_ref2va_nvfp4_mixed.safetensors` | 24.4 GB | 1.92 | ~20 GB | from unpruned bf16 |
|
| 31 |
| `minimax_h3_ref2va_nvfp4_full.safetensors` | 18.7 GB | 1.91 | ~16 GB | experimental |
|
| 32 |
|
| 33 |
-
Take **`pruned_nvfp4`** unless you have a specific reason not to: half the size of the
|
| 34 |
alternatives at identical speed, and it leaves the modulation path at full precision.
|
| 35 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 36 |
## Why the pruned base is the right one to quantize
|
| 37 |
|
| 38 |
Comfy-Org's `pruned` checkpoint is not lossily pruned β it is a **structural refactor of
|
|
@@ -156,7 +168,7 @@ reference images, and 3-4 varied shots hold identity far better than one.
|
|
| 156 |
| `vae/minimax_h3_audio_vae_fp32.safetensors` | FP32 | **Comfy-Org, unmodified** |
|
| 157 |
|
| 158 |
**The NVFP4 text encoder is Comfy-Org's work, not ours.** Only the
|
| 159 |
-
`
|
| 160 |
|
| 161 |
VAEs are deliberately **not** quantized: they are small, run once per generation rather than
|
| 162 |
per step, and decode straight to pixels and audio samples where error is immediately
|
|
@@ -167,7 +179,7 @@ visible. The text encoder being NVFP4 buys VRAM, not speed β it also runs once
|
|
| 167 |
```
|
| 168 |
π ComfyUI/models/
|
| 169 |
βββ π diffusion_models/
|
| 170 |
-
β βββ minimax_h3_ref2va_pruned_nvfp4.safetensors
|
| 171 |
βββ π text_encoders/
|
| 172 |
β βββ qwen3vl_32b_minimax_h3_nvfp4_awq.safetensors
|
| 173 |
βββ π vae/
|
|
@@ -177,18 +189,21 @@ visible. The text encoder being NVFP4 buys VRAM, not speed β it also runs once
|
|
| 177 |
|
| 178 |
Recommended stack total: **33.7 GB**. Use the official
|
| 179 |
[R2V template](https://github.com/Comfy-Org/workflow_templates/blob/main/templates/video_minimax_h3_r2v.json),
|
| 180 |
-
swapping the diffusion model
|
|
|
|
|
|
|
| 181 |
`comfy/ldm/minimax/`). `CLIPLoader` type must be `minimax`; sampler `res_multistep`;
|
| 182 |
frame `length` must satisfy 17n+5.
|
| 183 |
|
| 184 |
## Honest limitations
|
| 185 |
|
| 186 |
- Quality was compared against `pruned_int8_convrot` at three matched seeds with no visible
|
| 187 |
-
degradation, but this is **not a rigorous evaluation** β no FVD, no human study, no
|
| 188 |
-
|
|
|
|
|
|
|
| 189 |
- `pruned_nvfp4` is **doubly quantized** (bf16 -> int8_convrot by Comfy-Org -> NVFP4 here).
|
| 190 |
Error from both passes compounds. It held up in testing, but that is a real caveat.
|
| 191 |
-
- Only **ref2va** is converted. `fl2va` is not included.
|
| 192 |
- Benchmarks are single-GPU, one card, one resolution.
|
| 193 |
|
| 194 |
Failure cases are welcome in the discussions tab β concrete artifacts beat aggregate scores.
|
|
|
|
| 14 |
|
| 15 |
# MiniMax H3 β NVFP4
|
| 16 |
|
| 17 |
+
NVFP4 quantizations of the **MiniMax-H3** diffusion transformer for ComfyUI β both task
|
| 18 |
+
variants, `ref2va` (reference images β video) and `fl2va` (first/last frame β video).
|
| 19 |
|
| 20 |
- Original model: https://huggingface.co/MiniMaxAI/MiniMax-H3
|
| 21 |
- ComfyUI repackage these derive from: https://huggingface.co/Comfy-Org/MiniMax-H3
|
|
|
|
| 25 |
|
| 26 |
## Which file do I want?
|
| 27 |
|
| 28 |
+
First pick the **task**, then the file:
|
| 29 |
+
|
| 30 |
+
- **`ref2va`** β up to 9 reference images (+ videos/audio) β video. Identity-driven.
|
| 31 |
+
- **`fl2va`** β first and/or last frame β video. Interpolates between endpoints; also how
|
| 32 |
+
you chain clips past one generation by feeding the previous clip's last frame in.
|
| 33 |
+
|
| 34 |
| file | size | s/it | VRAM (DiT) | notes |
|
| 35 |
|---|---|---|---|---|
|
| 36 |
+
| **`minimax_h3_ref2va_pruned_nvfp4.safetensors`** | **12.5 GB** | **1.90** | 11.9 GB | **recommended, ref2va** |
|
| 37 |
+
| **`minimax_h3_fl2va_pruned_nvfp4.safetensors`** | **12.5 GB** | β | ~11.9 GB | **recommended, fl2va** |
|
| 38 |
| `minimax_h3_ref2va_nvfp4_mixed.safetensors` | 24.4 GB | 1.92 | ~20 GB | from unpruned bf16 |
|
| 39 |
| `minimax_h3_ref2va_nvfp4_full.safetensors` | 18.7 GB | 1.91 | ~16 GB | experimental |
|
| 40 |
|
| 41 |
+
Take a **`pruned_nvfp4`** file unless you have a specific reason not to: half the size of the
|
| 42 |
alternatives at identical speed, and it leaves the modulation path at full precision.
|
| 43 |
|
| 44 |
+
The two pruned files are the same size and were produced by the same script over the same
|
| 45 |
+
200 quantized layers β they differ only in task head. `fl2va` s/it is unmeasured but should
|
| 46 |
+
match `ref2va`; the architectures are identical.
|
| 47 |
+
|
| 48 |
## Why the pruned base is the right one to quantize
|
| 49 |
|
| 50 |
Comfy-Org's `pruned` checkpoint is not lossily pruned β it is a **structural refactor of
|
|
|
|
| 168 |
| `vae/minimax_h3_audio_vae_fp32.safetensors` | FP32 | **Comfy-Org, unmodified** |
|
| 169 |
|
| 170 |
**The NVFP4 text encoder is Comfy-Org's work, not ours.** Only the
|
| 171 |
+
`minimax_h3_*_nvfp4*.safetensors` diffusion models here are new.
|
| 172 |
|
| 173 |
VAEs are deliberately **not** quantized: they are small, run once per generation rather than
|
| 174 |
per step, and decode straight to pixels and audio samples where error is immediately
|
|
|
|
| 179 |
```
|
| 180 |
π ComfyUI/models/
|
| 181 |
βββ π diffusion_models/
|
| 182 |
+
β βββ minimax_h3_ref2va_pruned_nvfp4.safetensors (or the fl2va file)
|
| 183 |
βββ π text_encoders/
|
| 184 |
β βββ qwen3vl_32b_minimax_h3_nvfp4_awq.safetensors
|
| 185 |
βββ π vae/
|
|
|
|
| 189 |
|
| 190 |
Recommended stack total: **33.7 GB**. Use the official
|
| 191 |
[R2V template](https://github.com/Comfy-Org/workflow_templates/blob/main/templates/video_minimax_h3_r2v.json),
|
| 192 |
+
swapping the diffusion model β or the
|
| 193 |
+
[FL2V template](https://github.com/Comfy-Org/workflow_templates/blob/main/templates/video_minimax_h3_fl2v.json)
|
| 194 |
+
for the `fl2va` file. Requires ComfyUI >= 0.30.0 (native H3 support in
|
| 195 |
`comfy/ldm/minimax/`). `CLIPLoader` type must be `minimax`; sampler `res_multistep`;
|
| 196 |
frame `length` must satisfy 17n+5.
|
| 197 |
|
| 198 |
## Honest limitations
|
| 199 |
|
| 200 |
- Quality was compared against `pruned_int8_convrot` at three matched seeds with no visible
|
| 201 |
+
degradation, but this is **not a rigorous evaluation** β no FVD, no human study, no 2K
|
| 202 |
+
testing. 15s (362 frames) generates fine at 480x864.
|
| 203 |
+
- The **`fl2va` file is unbenchmarked** β it was produced by the same script over the same
|
| 204 |
+
layer set as `ref2va`, but has not been run end-to-end.
|
| 205 |
- `pruned_nvfp4` is **doubly quantized** (bf16 -> int8_convrot by Comfy-Org -> NVFP4 here).
|
| 206 |
Error from both passes compounds. It held up in testing, but that is a real caveat.
|
|
|
|
| 207 |
- Benchmarks are single-GPU, one card, one resolution.
|
| 208 |
|
| 209 |
Failure cases are welcome in the discussions tab β concrete artifacts beat aggregate scores.
|