Text-to-Video
Diffusers
MiniMax H3
MiniMaxH3Pipeline
custom_minimax_h3
video-generation
image-to-video
audio-video-generation
quantized
4-bit precision
int4
svdquant
quantfunc
comfyui
Instructions to use QuantFunc/Minimax-H3-Quantfunc-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use QuantFunc/Minimax-H3-Quantfunc-4bit with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("QuantFunc/Minimax-H3-Quantfunc-4bit", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
Add README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,150 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: other
|
| 3 |
+
license_name: minimax-h3-community-license
|
| 4 |
+
base_model_relation: quantized
|
| 5 |
+
pipeline_tag: text-to-video
|
| 6 |
+
library_name: diffusers
|
| 7 |
+
tags:
|
| 8 |
+
- video-generation
|
| 9 |
+
- text-to-video
|
| 10 |
+
- image-to-video
|
| 11 |
+
- audio-video-generation
|
| 12 |
+
- quantized
|
| 13 |
+
- 4-bit
|
| 14 |
+
- int4
|
| 15 |
+
- svdquant
|
| 16 |
+
- minimax-h3
|
| 17 |
+
- quantfunc
|
| 18 |
+
- comfyui
|
| 19 |
+
---
|
| 20 |
+
|
| 21 |
+
<div align="center" style="margin-top: 50px;">
|
| 22 |
+
<a href="https://github.com/QuantFunc/ComfyUI-QuantFunc">
|
| 23 |
+
<img src="https://raw.githubusercontent.com/QuantFunc/ComfyUI-QuantFunc/main/assets/logo.webp" width="300" alt="QuantFunc logo">
|
| 24 |
+
</a>
|
| 25 |
+
</div>
|
| 26 |
+
|
| 27 |
+
<p align="center">
|
| 28 |
+
๐ <a href="https://www.quantfunc.com/">Website</a> |
|
| 29 |
+
๐ <a href="https://github.com/QuantFunc/ComfyUI-QuantFunc">GitHub</a> |
|
| 30 |
+
๐ค <a href="https://huggingface.co/QuantFunc">Hugging Face</a> |
|
| 31 |
+
๐ค <a href="https://www.modelscope.cn/profile/QuantFunc">ModelScope</a> |
|
| 32 |
+
๐ฎ <a href="https://discord.gg/jCp9TpFWcn">Discord</a>
|
| 33 |
+
</p>
|
| 34 |
+
|
| 35 |
+
# MiniMax-H3-QuantFunc-4bit
|
| 36 |
+
|
| 37 |
+
**4x compression, quality held.**
|
| 38 |
+
|
| 39 |
+
QuantFunc INT4 cuts MiniMax H3's core weight precision from 16-bit to 4-bit. Character detail, style fidelity and fast motion stay clear and coherent, while H3's native video+audio generation is fully preserved.
|
| 40 |
+
|
| 41 |
+
In our internal FL2VA evaluation, QuantFunc INT4 vs the BF16 baseline (same prompt, same seed) measures ~**23.7 dB PSNR**.
|
| 42 |
+
|
| 43 |
+
## Showcase
|
| 44 |
+
|
| 45 |
+
All clips below were generated by MiniMax-H3-QuantFunc-4bit โ click a player to watch.
|
| 46 |
+
|
| 47 |
+
<table>
|
| 48 |
+
<tr>
|
| 49 |
+
<th>Live-action performance</th>
|
| 50 |
+
<th>Animated chase</th>
|
| 51 |
+
</tr>
|
| 52 |
+
<tr>
|
| 53 |
+
<td>
|
| 54 |
+
<video controls preload="metadata" poster="./assets/h3_case1.webp" width="100%">
|
| 55 |
+
<source src="./assets/h3_case1.mp4" type="video/mp4">
|
| 56 |
+
</video>
|
| 57 |
+
</td>
|
| 58 |
+
<td>
|
| 59 |
+
<video controls preload="metadata" poster="./assets/h3_case2.webp" width="100%">
|
| 60 |
+
<source src="./assets/h3_case2.mp4" type="video/mp4">
|
| 61 |
+
</video>
|
| 62 |
+
</td>
|
| 63 |
+
</tr>
|
| 64 |
+
<tr>
|
| 65 |
+
<th>High-speed car chase</th>
|
| 66 |
+
<th>Stylized character</th>
|
| 67 |
+
</tr>
|
| 68 |
+
<tr>
|
| 69 |
+
<td>
|
| 70 |
+
<video controls preload="metadata" poster="./assets/h3_case3.webp" width="100%">
|
| 71 |
+
<source src="./assets/h3_case3.mp4" type="video/mp4">
|
| 72 |
+
</video>
|
| 73 |
+
</td>
|
| 74 |
+
<td>
|
| 75 |
+
<video controls preload="metadata" poster="./assets/h3_case4.webp" width="100%">
|
| 76 |
+
<source src="./assets/h3_case4.mp4" type="video/mp4">
|
| 77 |
+
</video>
|
| 78 |
+
</td>
|
| 79 |
+
</tr>
|
| 80 |
+
</table>
|
| 81 |
+
|
| 82 |
+
> Poster frames are the first frame of each clip. Showcase spec: 896 ร 1184, 124 frames, 24 FPS, ~5s.
|
| 83 |
+
|
| 84 |
+
## Same 124 frames, up to 3.19x FP8's per-step speed
|
| 85 |
+
|
| 86 |
+
On an **RTX 4090**, 768 ร 768, 5s, 124 frames:
|
| 87 |
+
|
| 88 |
+
| Backend | Per-step time | Relative speed |
|
| 89 |
+
|---|---:|---:|
|
| 90 |
+
| **QuantFunc INT4** | **3.2s** | โ |
|
| 91 |
+
| INT8 ConvRot | 8.5s | **2.66x faster** |
|
| 92 |
+
| FP8 | 10.2s | **3.19x faster** |
|
| 93 |
+
|
| 94 |
+
> Per-step core-model inference time only โ excludes text encoder, VAE, audio processing and video saving. Actual speed varies with resolution, frame count, driver and software version.
|
| 95 |
+
|
| 96 |
+
## Swap one loader, keep the rest of your workflow
|
| 97 |
+
|
| 98 |
+
1. Install or update [ComfyUI-QuantFunc](https://github.com/QuantFunc/ComfyUI-QuantFunc).
|
| 99 |
+
2. Download the FL2VA 4-step or Ref2VA 8-step weights.
|
| 100 |
+
3. Swap your model loader for the QuantFunc loader and pick the matching weight file.
|
| 101 |
+
|
| 102 |
+
Prompts, reference images/videos, audio assets and the rest of your workflow nodes stay unchanged.
|
| 103 |
+
|
| 104 |
+
Both weight sets already have the acceleration LoRA, Token Refiner, INT4 Refiner and INT8 Conv Sidecar fused in โ no extra components to attach.
|
| 105 |
+
|
| 106 |
+
## RTX 20-series through GB300, one build covers it all
|
| 107 |
+
|
| 108 |
+
Runs on every NVIDIA **SM75+** GPU: RTX 20/30/40/50-series, A100, H100, H200, B100, B200, GB300.
|
| 109 |
+
|
| 110 |
+
4-bit weights significantly cut the weight-bandwidth cost of loading and inference, making MiniMax H3 much easier to run on consumer GPUs. Actual VRAM needs depend on resolution, frame count, reference-asset count and the rest of your workflow.
|
| 111 |
+
|
| 112 |
+
## Choose a model
|
| 113 |
+
|
| 114 |
+
| Variant | File | Size | Recommended steps | Use case |
|
| 115 |
+
|---|---|---:|---:|---|
|
| 116 |
+
| **FL2VA** | `minimax_h3_fl2va_4step_quantfunc_int4_r128.safetensors` | 12.37 GB | **4 steps** | Text-to-audio/video, first-frame, last-frame, first+last-frame control |
|
| 117 |
+
| **Ref2VA** | `minimax_h3_ref2va_8steps_quantfunc_int4_r128.safetensors` | 12.37 GB | **8 steps** | Multimodal reference generation from images, video and audio |
|
| 118 |
+
|
| 119 |
+
FL2VA supports zero, one or two input images; Ref2VA targets more complex multimodal reference scenarios. See the [official MiniMax H3 repo](https://github.com/MiniMax-AI/MiniMax-H3) for details on both modes.
|
| 120 |
+
|
| 121 |
+
Use the matching scheduler for the model. Both weight sets already carry the acceleration LoRA fused in โ no need to load it separately.
|
| 122 |
+
|
| 123 |
+
## Loading
|
| 124 |
+
|
| 125 |
+
Weights use QuantFunc's own sealed safetensors format (quantization parameters and metadata are sealed).
|
| 126 |
+
|
| 127 |
+
Load with **ComfyUI-QuantFunc** or the **QuantFunc inference engine** โ this is not a drop-in Diffusers checkpoint. (This repo declares `library_name: diffusers` purely so Hugging Face counts real downloads of the flat `.safetensors` files above โ see [HF's download-stats docs](https://huggingface.co/docs/hub/models-download-stats) โ not because the files load via the `diffusers` package.)
|
| 128 |
+
|
| 129 |
+
If the model isn't recognized or fails to load, update ComfyUI-QuantFunc to the latest version and restart ComfyUI.
|
| 130 |
+
|
| 131 |
+
## Technical details
|
| 132 |
+
|
| 133 |
+
- INT4 weights ร INT4 activations (W4A4)
|
| 134 |
+
- SVDQuant rank 128, group size 64
|
| 135 |
+
- INT4 Token Refiner + INT4 Refiner
|
| 136 |
+
- INT8 Conv Sidecar
|
| 137 |
+
- FL2VA measured max relative output error from fp16 adaLN folding: ~**7.58e-4**
|
| 138 |
+
- Minimum GPU architecture: NVIDIA SM75
|
| 139 |
+
|
| 140 |
+
## Source & license
|
| 141 |
+
|
| 142 |
+
This repository distributes derived quantized weights produced from [MiniMax H3](https://github.com/MiniMax-AI/MiniMax-H3).
|
| 143 |
+
|
| 144 |
+
MiniMax H3 and its derivative weights follow the **MiniMax H3 Community License Agreement**. QuantFunc's quantization tooling and implementation follow their own respective licenses. Please read and comply with the original model's license terms before use.
|
| 145 |
+
|
| 146 |
+
## Community
|
| 147 |
+
|
| 148 |
+
- ๐ [QuantFunc website](https://www.quantfunc.com/)
|
| 149 |
+
- ๐ [ComfyUI-QuantFunc on GitHub](https://github.com/QuantFunc/ComfyUI-QuantFunc)
|
| 150 |
+
- ๐ฎ [Discord](https://discord.gg/jCp9TpFWcn)
|