lilcheaty commited on
Commit
43bdd63
Β·
verified Β·
1 Parent(s): 63457cb

Document fl2va_pruned_nvfp4

Browse files
Files changed (1) hide show
  1. README.md +24 -9
README.md CHANGED
@@ -14,7 +14,8 @@ base_model_relation: quantized
14
 
15
  # MiniMax H3 β€” NVFP4
16
 
17
- NVFP4 quantizations of the **MiniMax-H3** ref2va diffusion transformer for ComfyUI.
 
18
 
19
  - Original model: https://huggingface.co/MiniMaxAI/MiniMax-H3
20
  - ComfyUI repackage these derive from: https://huggingface.co/Comfy-Org/MiniMax-H3
@@ -24,15 +25,26 @@ Hopper or older the NVFP4 path is emulated β€” use Comfy-Org's `int8_convrot` fi
24
 
25
  ## Which file do I want?
26
 
 
 
 
 
 
 
27
  | file | size | s/it | VRAM (DiT) | notes |
28
  |---|---|---|---|---|
29
- | **`minimax_h3_ref2va_pruned_nvfp4.safetensors`** | **12.5 GB** | **1.90** | 11.9 GB | **recommended** |
 
30
  | `minimax_h3_ref2va_nvfp4_mixed.safetensors` | 24.4 GB | 1.92 | ~20 GB | from unpruned bf16 |
31
  | `minimax_h3_ref2va_nvfp4_full.safetensors` | 18.7 GB | 1.91 | ~16 GB | experimental |
32
 
33
- Take **`pruned_nvfp4`** unless you have a specific reason not to: half the size of the
34
  alternatives at identical speed, and it leaves the modulation path at full precision.
35
 
 
 
 
 
36
  ## Why the pruned base is the right one to quantize
37
 
38
  Comfy-Org's `pruned` checkpoint is not lossily pruned β€” it is a **structural refactor of
@@ -156,7 +168,7 @@ reference images, and 3-4 varied shots hold identity far better than one.
156
  | `vae/minimax_h3_audio_vae_fp32.safetensors` | FP32 | **Comfy-Org, unmodified** |
157
 
158
  **The NVFP4 text encoder is Comfy-Org's work, not ours.** Only the
159
- `minimax_h3_ref2va_*nvfp4*.safetensors` diffusion models here are new.
160
 
161
  VAEs are deliberately **not** quantized: they are small, run once per generation rather than
162
  per step, and decode straight to pixels and audio samples where error is immediately
@@ -167,7 +179,7 @@ visible. The text encoder being NVFP4 buys VRAM, not speed β€” it also runs once
167
  ```
168
  πŸ“‚ ComfyUI/models/
169
  β”œβ”€β”€ πŸ“‚ diffusion_models/
170
- β”‚ └── minimax_h3_ref2va_pruned_nvfp4.safetensors
171
  β”œβ”€β”€ πŸ“‚ text_encoders/
172
  β”‚ └── qwen3vl_32b_minimax_h3_nvfp4_awq.safetensors
173
  └── πŸ“‚ vae/
@@ -177,18 +189,21 @@ visible. The text encoder being NVFP4 buys VRAM, not speed β€” it also runs once
177
 
178
  Recommended stack total: **33.7 GB**. Use the official
179
  [R2V template](https://github.com/Comfy-Org/workflow_templates/blob/main/templates/video_minimax_h3_r2v.json),
180
- swapping the diffusion model. Requires ComfyUI >= 0.30.0 (native H3 support in
 
 
181
  `comfy/ldm/minimax/`). `CLIPLoader` type must be `minimax`; sampler `res_multistep`;
182
  frame `length` must satisfy 17n+5.
183
 
184
  ## Honest limitations
185
 
186
  - Quality was compared against `pruned_int8_convrot` at three matched seeds with no visible
187
- degradation, but this is **not a rigorous evaluation** β€” no FVD, no human study, no
188
- long-duration or 2K testing.
 
 
189
  - `pruned_nvfp4` is **doubly quantized** (bf16 -> int8_convrot by Comfy-Org -> NVFP4 here).
190
  Error from both passes compounds. It held up in testing, but that is a real caveat.
191
- - Only **ref2va** is converted. `fl2va` is not included.
192
  - Benchmarks are single-GPU, one card, one resolution.
193
 
194
  Failure cases are welcome in the discussions tab β€” concrete artifacts beat aggregate scores.
 
14
 
15
  # MiniMax H3 β€” NVFP4
16
 
17
+ NVFP4 quantizations of the **MiniMax-H3** diffusion transformer for ComfyUI β€” both task
18
+ variants, `ref2va` (reference images β†’ video) and `fl2va` (first/last frame β†’ video).
19
 
20
  - Original model: https://huggingface.co/MiniMaxAI/MiniMax-H3
21
  - ComfyUI repackage these derive from: https://huggingface.co/Comfy-Org/MiniMax-H3
 
25
 
26
  ## Which file do I want?
27
 
28
+ First pick the **task**, then the file:
29
+
30
+ - **`ref2va`** β€” up to 9 reference images (+ videos/audio) β†’ video. Identity-driven.
31
+ - **`fl2va`** β€” first and/or last frame β†’ video. Interpolates between endpoints; also how
32
+ you chain clips past one generation by feeding the previous clip's last frame in.
33
+
34
  | file | size | s/it | VRAM (DiT) | notes |
35
  |---|---|---|---|---|
36
+ | **`minimax_h3_ref2va_pruned_nvfp4.safetensors`** | **12.5 GB** | **1.90** | 11.9 GB | **recommended, ref2va** |
37
+ | **`minimax_h3_fl2va_pruned_nvfp4.safetensors`** | **12.5 GB** | β€” | ~11.9 GB | **recommended, fl2va** |
38
  | `minimax_h3_ref2va_nvfp4_mixed.safetensors` | 24.4 GB | 1.92 | ~20 GB | from unpruned bf16 |
39
  | `minimax_h3_ref2va_nvfp4_full.safetensors` | 18.7 GB | 1.91 | ~16 GB | experimental |
40
 
41
+ Take a **`pruned_nvfp4`** file unless you have a specific reason not to: half the size of the
42
  alternatives at identical speed, and it leaves the modulation path at full precision.
43
 
44
+ The two pruned files are the same size and were produced by the same script over the same
45
+ 200 quantized layers β€” they differ only in task head. `fl2va` s/it is unmeasured but should
46
+ match `ref2va`; the architectures are identical.
47
+
48
  ## Why the pruned base is the right one to quantize
49
 
50
  Comfy-Org's `pruned` checkpoint is not lossily pruned β€” it is a **structural refactor of
 
168
  | `vae/minimax_h3_audio_vae_fp32.safetensors` | FP32 | **Comfy-Org, unmodified** |
169
 
170
  **The NVFP4 text encoder is Comfy-Org's work, not ours.** Only the
171
+ `minimax_h3_*_nvfp4*.safetensors` diffusion models here are new.
172
 
173
  VAEs are deliberately **not** quantized: they are small, run once per generation rather than
174
  per step, and decode straight to pixels and audio samples where error is immediately
 
179
  ```
180
  πŸ“‚ ComfyUI/models/
181
  β”œβ”€β”€ πŸ“‚ diffusion_models/
182
+ β”‚ └── minimax_h3_ref2va_pruned_nvfp4.safetensors (or the fl2va file)
183
  β”œβ”€β”€ πŸ“‚ text_encoders/
184
  β”‚ └── qwen3vl_32b_minimax_h3_nvfp4_awq.safetensors
185
  └── πŸ“‚ vae/
 
189
 
190
  Recommended stack total: **33.7 GB**. Use the official
191
  [R2V template](https://github.com/Comfy-Org/workflow_templates/blob/main/templates/video_minimax_h3_r2v.json),
192
+ swapping the diffusion model β€” or the
193
+ [FL2V template](https://github.com/Comfy-Org/workflow_templates/blob/main/templates/video_minimax_h3_fl2v.json)
194
+ for the `fl2va` file. Requires ComfyUI >= 0.30.0 (native H3 support in
195
  `comfy/ldm/minimax/`). `CLIPLoader` type must be `minimax`; sampler `res_multistep`;
196
  frame `length` must satisfy 17n+5.
197
 
198
  ## Honest limitations
199
 
200
  - Quality was compared against `pruned_int8_convrot` at three matched seeds with no visible
201
+ degradation, but this is **not a rigorous evaluation** β€” no FVD, no human study, no 2K
202
+ testing. 15s (362 frames) generates fine at 480x864.
203
+ - The **`fl2va` file is unbenchmarked** β€” it was produced by the same script over the same
204
+ layer set as `ref2va`, but has not been run end-to-end.
205
  - `pruned_nvfp4` is **doubly quantized** (bf16 -> int8_convrot by Comfy-Org -> NVFP4 here).
206
  Error from both passes compounds. It held up in testing, but that is a real caveat.
 
207
  - Benchmarks are single-GPU, one card, one resolution.
208
 
209
  Failure cases are welcome in the discussions tab β€” concrete artifacts beat aggregate scores.