QuantFunc commited on
Commit
cbd3bfa
ยท
verified ยท
1 Parent(s): 97c83aa

Add README.md

Browse files
Files changed (1) hide show
  1. README.md +150 -0
README.md ADDED
@@ -0,0 +1,150 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: minimax-h3-community-license
4
+ base_model_relation: quantized
5
+ pipeline_tag: text-to-video
6
+ library_name: diffusers
7
+ tags:
8
+ - video-generation
9
+ - text-to-video
10
+ - image-to-video
11
+ - audio-video-generation
12
+ - quantized
13
+ - 4-bit
14
+ - int4
15
+ - svdquant
16
+ - minimax-h3
17
+ - quantfunc
18
+ - comfyui
19
+ ---
20
+
21
+ <div align="center" style="margin-top: 50px;">
22
+ <a href="https://github.com/QuantFunc/ComfyUI-QuantFunc">
23
+ <img src="https://raw.githubusercontent.com/QuantFunc/ComfyUI-QuantFunc/main/assets/logo.webp" width="300" alt="QuantFunc logo">
24
+ </a>
25
+ </div>
26
+
27
+ <p align="center">
28
+ ๐ŸŒ <a href="https://www.quantfunc.com/">Website</a> &nbsp;|&nbsp;
29
+ ๐Ÿ™ <a href="https://github.com/QuantFunc/ComfyUI-QuantFunc">GitHub</a> &nbsp;|&nbsp;
30
+ ๐Ÿค— <a href="https://huggingface.co/QuantFunc">Hugging Face</a> &nbsp;|&nbsp;
31
+ ๐Ÿค– <a href="https://www.modelscope.cn/profile/QuantFunc">ModelScope</a> &nbsp;|&nbsp;
32
+ ๐ŸŽฎ <a href="https://discord.gg/jCp9TpFWcn">Discord</a>
33
+ </p>
34
+
35
+ # MiniMax-H3-QuantFunc-4bit
36
+
37
+ **4x compression, quality held.**
38
+
39
+ QuantFunc INT4 cuts MiniMax H3's core weight precision from 16-bit to 4-bit. Character detail, style fidelity and fast motion stay clear and coherent, while H3's native video+audio generation is fully preserved.
40
+
41
+ In our internal FL2VA evaluation, QuantFunc INT4 vs the BF16 baseline (same prompt, same seed) measures ~**23.7 dB PSNR**.
42
+
43
+ ## Showcase
44
+
45
+ All clips below were generated by MiniMax-H3-QuantFunc-4bit โ€” click a player to watch.
46
+
47
+ <table>
48
+ <tr>
49
+ <th>Live-action performance</th>
50
+ <th>Animated chase</th>
51
+ </tr>
52
+ <tr>
53
+ <td>
54
+ <video controls preload="metadata" poster="./assets/h3_case1.webp" width="100%">
55
+ <source src="./assets/h3_case1.mp4" type="video/mp4">
56
+ </video>
57
+ </td>
58
+ <td>
59
+ <video controls preload="metadata" poster="./assets/h3_case2.webp" width="100%">
60
+ <source src="./assets/h3_case2.mp4" type="video/mp4">
61
+ </video>
62
+ </td>
63
+ </tr>
64
+ <tr>
65
+ <th>High-speed car chase</th>
66
+ <th>Stylized character</th>
67
+ </tr>
68
+ <tr>
69
+ <td>
70
+ <video controls preload="metadata" poster="./assets/h3_case3.webp" width="100%">
71
+ <source src="./assets/h3_case3.mp4" type="video/mp4">
72
+ </video>
73
+ </td>
74
+ <td>
75
+ <video controls preload="metadata" poster="./assets/h3_case4.webp" width="100%">
76
+ <source src="./assets/h3_case4.mp4" type="video/mp4">
77
+ </video>
78
+ </td>
79
+ </tr>
80
+ </table>
81
+
82
+ > Poster frames are the first frame of each clip. Showcase spec: 896 ร— 1184, 124 frames, 24 FPS, ~5s.
83
+
84
+ ## Same 124 frames, up to 3.19x FP8's per-step speed
85
+
86
+ On an **RTX 4090**, 768 ร— 768, 5s, 124 frames:
87
+
88
+ | Backend | Per-step time | Relative speed |
89
+ |---|---:|---:|
90
+ | **QuantFunc INT4** | **3.2s** | โ€” |
91
+ | INT8 ConvRot | 8.5s | **2.66x faster** |
92
+ | FP8 | 10.2s | **3.19x faster** |
93
+
94
+ > Per-step core-model inference time only โ€” excludes text encoder, VAE, audio processing and video saving. Actual speed varies with resolution, frame count, driver and software version.
95
+
96
+ ## Swap one loader, keep the rest of your workflow
97
+
98
+ 1. Install or update [ComfyUI-QuantFunc](https://github.com/QuantFunc/ComfyUI-QuantFunc).
99
+ 2. Download the FL2VA 4-step or Ref2VA 8-step weights.
100
+ 3. Swap your model loader for the QuantFunc loader and pick the matching weight file.
101
+
102
+ Prompts, reference images/videos, audio assets and the rest of your workflow nodes stay unchanged.
103
+
104
+ Both weight sets already have the acceleration LoRA, Token Refiner, INT4 Refiner and INT8 Conv Sidecar fused in โ€” no extra components to attach.
105
+
106
+ ## RTX 20-series through GB300, one build covers it all
107
+
108
+ Runs on every NVIDIA **SM75+** GPU: RTX 20/30/40/50-series, A100, H100, H200, B100, B200, GB300.
109
+
110
+ 4-bit weights significantly cut the weight-bandwidth cost of loading and inference, making MiniMax H3 much easier to run on consumer GPUs. Actual VRAM needs depend on resolution, frame count, reference-asset count and the rest of your workflow.
111
+
112
+ ## Choose a model
113
+
114
+ | Variant | File | Size | Recommended steps | Use case |
115
+ |---|---|---:|---:|---|
116
+ | **FL2VA** | `minimax_h3_fl2va_4step_quantfunc_int4_r128.safetensors` | 12.37 GB | **4 steps** | Text-to-audio/video, first-frame, last-frame, first+last-frame control |
117
+ | **Ref2VA** | `minimax_h3_ref2va_8steps_quantfunc_int4_r128.safetensors` | 12.37 GB | **8 steps** | Multimodal reference generation from images, video and audio |
118
+
119
+ FL2VA supports zero, one or two input images; Ref2VA targets more complex multimodal reference scenarios. See the [official MiniMax H3 repo](https://github.com/MiniMax-AI/MiniMax-H3) for details on both modes.
120
+
121
+ Use the matching scheduler for the model. Both weight sets already carry the acceleration LoRA fused in โ€” no need to load it separately.
122
+
123
+ ## Loading
124
+
125
+ Weights use QuantFunc's own sealed safetensors format (quantization parameters and metadata are sealed).
126
+
127
+ Load with **ComfyUI-QuantFunc** or the **QuantFunc inference engine** โ€” this is not a drop-in Diffusers checkpoint. (This repo declares `library_name: diffusers` purely so Hugging Face counts real downloads of the flat `.safetensors` files above โ€” see [HF's download-stats docs](https://huggingface.co/docs/hub/models-download-stats) โ€” not because the files load via the `diffusers` package.)
128
+
129
+ If the model isn't recognized or fails to load, update ComfyUI-QuantFunc to the latest version and restart ComfyUI.
130
+
131
+ ## Technical details
132
+
133
+ - INT4 weights ร— INT4 activations (W4A4)
134
+ - SVDQuant rank 128, group size 64
135
+ - INT4 Token Refiner + INT4 Refiner
136
+ - INT8 Conv Sidecar
137
+ - FL2VA measured max relative output error from fp16 adaLN folding: ~**7.58e-4**
138
+ - Minimum GPU architecture: NVIDIA SM75
139
+
140
+ ## Source & license
141
+
142
+ This repository distributes derived quantized weights produced from [MiniMax H3](https://github.com/MiniMax-AI/MiniMax-H3).
143
+
144
+ MiniMax H3 and its derivative weights follow the **MiniMax H3 Community License Agreement**. QuantFunc's quantization tooling and implementation follow their own respective licenses. Please read and comply with the original model's license terms before use.
145
+
146
+ ## Community
147
+
148
+ - ๐ŸŒ [QuantFunc website](https://www.quantfunc.com/)
149
+ - ๐Ÿ™ [ComfyUI-QuantFunc on GitHub](https://github.com/QuantFunc/ComfyUI-QuantFunc)
150
+ - ๐ŸŽฎ [Discord](https://discord.gg/jCp9TpFWcn)