Met4physics commited on
Commit
95a3de4
·
verified ·
1 Parent(s): 23e2acb

docs: add ComfyUI quick start and badge

Browse files

Add a ComfyUI quick-start guide for 4-, 6-, and 8-step workflows and a linked SVG badge.

Files changed (2) hide show
  1. README.md +49 -0
  2. assets/comfyui-badge.svg +12 -0
README.md CHANGED
@@ -10,10 +10,13 @@ tags:
10
  - audio-video
11
  - minimax-h3
12
  - turbo
 
13
  ---
14
 
15
  # MiniMax-H3-Turbo
16
 
 
 
17
  Fixed-step MiniMax-H3 checkpoints for text-to-video with audio and first-frame-to-video with audio. This repository contains three variants:
18
 
19
  - `turbo-4step/`: four-step LoRA with fused video and audio output projections.
@@ -34,6 +37,52 @@ containing H.264 video and AAC audio; no separate WAV is written.
34
 
35
  Compare **Wuli at 4, 6 and 8 steps** with Larry v4, LightX2V, FlashGen, DMAD, PAI and the original MiniMax-H3 at 50 steps. The demo includes **9 prompts, 11 configurations and 99 videos**, with synchronized playback, step-count filters, side-by-side comparisons and selectable audio.
36
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
37
  ## Requirements
38
 
39
  The demo was tested with Diffusers 0.40.0 and huggingface_hub 1.27.0. Install a CUDA-enabled PyTorch build compatible with your driver, then install the remaining packages. Only these two versions are pinned:
 
10
  - audio-video
11
  - minimax-h3
12
  - turbo
13
+ - comfyui
14
  ---
15
 
16
  # MiniMax-H3-Turbo
17
 
18
+ [![ComfyUI: 4 / 6 / 8 steps](assets/comfyui-badge.svg)](https://github.com/wuli-art/MiniMax-H3-Turbo-ComfyUI)
19
+
20
  Fixed-step MiniMax-H3 checkpoints for text-to-video with audio and first-frame-to-video with audio. This repository contains three variants:
21
 
22
  - `turbo-4step/`: four-step LoRA with fused video and audio output projections.
 
37
 
38
  Compare **Wuli at 4, 6 and 8 steps** with Larry v4, LightX2V, FlashGen, DMAD, PAI and the original MiniMax-H3 at 50 steps. The demo includes **9 prompts, 11 configurations and 99 videos**, with synchronized playback, step-count filters, side-by-side comparisons and selectable audio.
39
 
40
+ ## ComfyUI
41
+
42
+ Use the [MiniMax H3 Turbo ComfyUI node pack](https://github.com/wuli-art/MiniMax-H3-Turbo-ComfyUI) to generate video and audio with **4, 6, or 8 steps** and save them together as one MP4.
43
+
44
+ ### 1. Install the nodes
45
+
46
+ Use a local ComfyUI installation with CUDA-enabled PyTorch. Clone the node pack into `ComfyUI/custom_nodes/` and install its dependencies with the **same Python environment that runs ComfyUI**:
47
+
48
+ ```bash
49
+ cd /path/to/ComfyUI/custom_nodes
50
+ git clone https://github.com/wuli-art/MiniMax-H3-Turbo-ComfyUI.git
51
+ cd MiniMax-H3-Turbo-ComfyUI
52
+ python -m pip install -r requirements.txt
53
+ ```
54
+
55
+ For Windows Portable, run the dependency command from the `ComfyUI_windows_portable` directory using its embedded Python:
56
+
57
+ ```powershell
58
+ .\python_embeded\python.exe -m pip install -r .\ComfyUI\custom_nodes\MiniMax-H3-Turbo-ComfyUI\requirements.txt
59
+ ```
60
+
61
+ Restart ComfyUI. The node pack requires `diffusers==0.40.0`, `transformers>=4.57.0`, and `peft>=0.17.0`; its `requirements.txt` installs the required packages. When updating an existing installation, install the requirements again before restarting.
62
+
63
+ ### 2. Load a workflow
64
+
65
+ Download a workflow JSON below and drag it into ComfyUI:
66
+
67
+ | Variant | Text-to-video workflow | Selection |
68
+ | --- | --- | --- |
69
+ | 4 steps | [t2va_4step.json](https://raw.githubusercontent.com/wuli-art/MiniMax-H3-Turbo-ComfyUI/main/example_workflows/t2va_4step.json) | `steps = 4` |
70
+ | 6 steps | [t2va_8step.json](https://raw.githubusercontent.com/wuli-art/MiniMax-H3-Turbo-ComfyUI/main/example_workflows/t2va_8step.json) | Change `steps` to `6` |
71
+ | 8 steps | [t2va_8step.json](https://raw.githubusercontent.com/wuli-art/MiniMax-H3-Turbo-ComfyUI/main/example_workflows/t2va_8step.json) | `steps = 8` |
72
+
73
+ The workflows connect **MiniMax H3 Turbo Generate** to **MiniMax H3 Turbo Save MP4**. The default generation settings are `seed = 42`, `num_frames = 124`, `height = 768`, and `width = 1344`.
74
+
75
+ ### 3. Generate a video with audio
76
+
77
+ 1. Select `steps` and enter your scene and desired sound in `prompt`.
78
+ 2. Leave `model_root` empty for automatic downloads. Keep `components_root` set to `MiniMaxAI/MiniMax-H3`.
79
+ 3. For text-to-video, leave `first_frame` and `last_frame` disconnected.
80
+ 4. Run the workflow. The first run downloads and loads the selected Turbo weights and official components. The save node writes a 24 fps H.264/AAC MP4 to ComfyUI's output directory.
81
+
82
+ For frame-conditioned generation, use [fl2va_4step.json](https://raw.githubusercontent.com/wuli-art/MiniMax-H3-Turbo-ComfyUI/main/example_workflows/fl2va_4step.json) or [fl2va_8step.json](https://raw.githubusercontent.com/wuli-art/MiniMax-H3-Turbo-ComfyUI/main/example_workflows/fl2va_8step.json). Select your image in **Load Image** and connect it to `first_frame`; connect a second **Load Image** node to `last_frame` when a final frame is also provided. For 6 steps, use the 8-step example and change `steps` to `6`.
83
+
84
+ See the [node pack README](https://github.com/wuli-art/MiniMax-H3-Turbo-ComfyUI#readme) for installation and usage details, or [open an issue](https://github.com/wuli-art/MiniMax-H3-Turbo-ComfyUI/issues) for ComfyUI-specific problems.
85
+
86
  ## Requirements
87
 
88
  The demo was tested with Diffusers 0.40.0 and huggingface_hub 1.27.0. Install a CUDA-enabled PyTorch build compatible with your driver, then install the remaining packages. Only these two versions are pinned:
assets/comfyui-badge.svg ADDED