Instructions to use ZhengmingYu/DMAD with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use ZhengmingYu/DMAD with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import export_to_video # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("MiniMaxAI/MiniMax-H3", dtype=torch.bfloat16, device_map="cuda") pipe.load_lora_weights("ZhengmingYu/DMAD") prompt = "A man with short gray hair plays a red electric guitar." output = pipe(prompt=prompt).frames[0] export_to_video(output, "output.mp4") - Inference
- Notebooks
- Google Colab
- Kaggle
Model card: ComfyUI section
Browse files
README.md
CHANGED
|
@@ -70,6 +70,19 @@ python inference.py --model-dir models/MiniMax-H3 --lora ckpt/minimax_h3/dmad_mi
|
|
| 70 |
--prompt-file prompts/dmad_sweater.txt --seed 42 --output-dir outputs/dmad_sweater
|
| 71 |
```
|
| 72 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 73 |
## Wan2.1 (text-to-video)
|
| 74 |
|
| 75 |
Full generators (EMA, spectral norm folded in) in the `.pth` format of
|
|
|
|
| 70 |
--prompt-file prompts/dmad_sweater.txt --seed 42 --output-dir outputs/dmad_sweater
|
| 71 |
```
|
| 72 |
|
| 73 |
+
## ComfyUI
|
| 74 |
+
|
| 75 |
+
`comfyui/dmad_minimax_h3_4step_{lora_critic,full_critic}_comfyui.safetensors` are the same two LoRAs converted exactly
|
| 76 |
+
to ComfyUI's MiniMax-H3 key layout (rank 128; q/k/v fused into `attn.qkv_proj` adapters of rank 384, alpha = rank,
|
| 77 |
+
scale 1.0 — no rank reduction; 2.0 GB each). Load with `LoraLoaderModelOnly` at strength 1.0, cfg 1.0,
|
| 78 |
+
`ModelSamplingMiniMaxH3` with shift 12 / audio shift 2, and sample with the **DMAD Sampler** + **DMAD Sigmas** nodes
|
| 79 |
+
from [`comfyui/ComfyUI-DMAD`](https://github.com/Yzmblog/DMAD/tree/main/comfyui/ComfyUI-DMAD) (the re-noise multistep
|
| 80 |
+
rule the students were trained with; stock samplers are not their operating point).
|
| 81 |
+
|
| 82 |
+
```bash
|
| 83 |
+
hf download ZhengmingYu/DMAD --include "comfyui/*" --local-dir /path/to/ComfyUI/models/loras
|
| 84 |
+
```
|
| 85 |
+
|
| 86 |
## Wan2.1 (text-to-video)
|
| 87 |
|
| 88 |
Full generators (EMA, spectral norm folded in) in the `.pth` format of
|