Instructions to use ZhengmingYu/DMAD with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use ZhengmingYu/DMAD with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import export_to_video # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("MiniMaxAI/MiniMax-H3", dtype=torch.bfloat16, device_map="cuda") pipe.load_lora_weights("ZhengmingYu/DMAD") prompt = "A man with short gray hair plays a red electric guitar." output = pipe(prompt=prompt).frames[0] export_to_video(output, "output.mp4") - Inference
- Notebooks
- Google Colab
- Kaggle
Link the Wan2.1 training data (DMAD-Wan-data)
Browse files
README.md
CHANGED
|
@@ -49,6 +49,8 @@ students of the **EDM ImageNet-64** teacher. The inference and training code is
|
|
| 49 |
|
| 50 |
## Updates
|
| 51 |
|
|
|
|
|
|
|
| 52 |
* **2026/10/10:** 8 GB GPUs: a 5 s [ComfyUI workflow](#ready-to-run-workflows-8-gb-gpu-and-up) for 8 GB GPUs, and
|
| 53 |
`--low-vram` in the [code repository](https://github.com/Yzmblog/DMAD#on-consumer-gpus) now makes 5 s videos in under
|
| 54 |
7 GiB of GPU memory and 15 s videos in 12 GiB 🪶
|
|
@@ -193,6 +195,10 @@ hf download ZhengmingYu/DMAD --include "wan2.1/*" --local-dir ckpt
|
|
| 193 |
bash experiments/dmad/sample.sh 1.3B ckpt/wan2.1/dmad_wan2pt1_1pt3B.pth my_prompts.json outputs/samples # in train/wan
|
| 194 |
```
|
| 195 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 196 |
## SDXL (text-to-image)
|
| 197 |
|
| 198 |
UNet state dicts in fp16 (spectral norm folded in) that load into the standard SDXL pipeline; see
|
|
|
|
| 49 |
|
| 50 |
## Updates
|
| 51 |
|
| 52 |
+
* **2026/10/15:** The [Wan2.1 training data](https://huggingface.co/datasets/ZhengmingYu/DMAD-Wan-data) (42,158
|
| 53 |
+
Wan2.1-14B teacher samples with their real-video latents), so `train/wan` can start training right away 🤗
|
| 54 |
* **2026/10/10:** 8 GB GPUs: a 5 s [ComfyUI workflow](#ready-to-run-workflows-8-gb-gpu-and-up) for 8 GB GPUs, and
|
| 55 |
`--low-vram` in the [code repository](https://github.com/Yzmblog/DMAD#on-consumer-gpus) now makes 5 s videos in under
|
| 56 |
7 GiB of GPU memory and 15 s videos in 12 GiB 🪶
|
|
|
|
| 195 |
bash experiments/dmad/sample.sh 1.3B ckpt/wan2.1/dmad_wan2pt1_1pt3B.pth my_prompts.json outputs/samples # in train/wan
|
| 196 |
```
|
| 197 |
|
| 198 |
+
The training data of both students (42,158 rows: Wan2.1-14B teacher sample, umT5 embedding and the caption-paired
|
| 199 |
+
UltraVideo clip latent, 531 GB of WebDataset shards) is at
|
| 200 |
+
[ZhengmingYu/DMAD-Wan-data](https://huggingface.co/datasets/ZhengmingYu/DMAD-Wan-data).
|
| 201 |
+
|
| 202 |
## SDXL (text-to-image)
|
| 203 |
|
| 204 |
UNet state dicts in fp16 (spectral norm folded in) that load into the standard SDXL pipeline; see
|