Buckets:
| license: other | |
| license_name: minimax-h3-community-license | |
| license_link: https://huggingface.co/MiniMaxAI/MiniMax-H3 | |
| tags: | |
| - video-generation | |
| - character-replacement | |
| - minimax-h3 | |
| - viggle | |
| - comfyui | |
| - int8 | |
| - convrot | |
| - dance | |
| - motion-transfer | |
| pipeline_tag: video-to-video | |
| # Viggle-Animate — ComfyUI conversions | |
| ComfyUI-native conversions of **[Viggle/Viggle-Animate](https://huggingface.co/Viggle/Viggle-Animate)** — | |
| a 33.1 B full finetune of MiniMax-H3's `ref2va` transformer for **character replacement in video**: | |
| a driving clip provides motion, camera, background and lighting; one reference still provides the | |
| character. No text encoder — conditioning is a frozen 362-token embedding. The sampler is | |
| DMD2-distilled: **4 steps (3 forward passes)**. | |
| **ComfyUI node pack (required for the conditioning layout):** | |
| [github.com/Saganaki22/ComfyUI-Viggle-Animate-H3](https://github.com/Saganaki22/ComfyUI-Viggle-Animate-H3) | |
|  | |
| | Example | Video | | |
| |---|---| | |
| | **Example 1** | <video src="https://huggingface.co/drbaph/Viggle-Animate-ComfyUI/resolve/main/00000_00006.mp4" controls loop width="100%"></video> | | |
| | **Example 2** | <video src="https://huggingface.co/drbaph/Viggle-Animate-ComfyUI/resolve/main/00000_00007.mp4" controls loop width="100%"></video> | | |
| | **Example 3** | <video src="https://huggingface.co/drbaph/Viggle-Animate-ComfyUI/resolve/main/00000_00009.mp4" controls loop width="100%"></video> | | |
| | **Example 4** | <video src="https://huggingface.co/drbaph/Viggle-Animate-ComfyUI/resolve/main/00000_00013.mp4" controls loop width="100%"></video> | | |
| ## Model Links | |
| **diffusion_models** (pick one — pruned is the VRAM-friendly option) | |
| - [minimax_h3_ref2va_viggle_pruned_int8_convrot.safetensors](https://huggingface.co/drbaph/Viggle-Animate-ComfyUI/resolve/main/diffusion_models/minimax_h3_ref2va_viggle_pruned_int8_convrot.safetensors) (21 GB) | |
| - [minimax_h3_ref2va_viggle_int8_convrot.safetensors](https://huggingface.co/drbaph/Viggle-Animate-ComfyUI/resolve/main/diffusion_models/minimax_h3_ref2va_viggle_int8_convrot.safetensors) (47 GB) | |
| - [minimax_h3_ref2va_viggle_bf16.safetensors](https://huggingface.co/drbaph/Viggle-Animate-ComfyUI/resolve/main/diffusion_models/minimax_h3_ref2va_viggle_bf16.safetensors) (66.3 GB, max quality) | |
| **loras** (DMD 4-step accelerator — pick one) | |
| - [viggle_animate_dmd_lora_r64.safetensors](https://huggingface.co/drbaph/Viggle-Animate-ComfyUI/resolve/main/loras/viggle_animate_dmd_lora_r64.safetensors) (0.94 GB, recommended) | |
| - [viggle_animate_dmd_lora.safetensors](https://huggingface.co/drbaph/Viggle-Animate-ComfyUI/resolve/main/loras/viggle_animate_dmd_lora.safetensors) (3.8 GB, full rank) | |
| **text_cond** | |
| - [fixed_embed_fwd_anyframe.safetensors](https://huggingface.co/drbaph/Viggle-Animate-ComfyUI/resolve/main/text_cond/fixed_embed_fwd_anyframe.safetensors) — precomputed text conditioning, load with **Load Text Conditioning (Viggle)** (no text encoder needed) | |
| **vae** | |
| - [minimax_h3_video_vae_int8_convrot.safetensors](https://huggingface.co/Kijai/MiniMax-H3-experimental/resolve/main/minimax_h3_video_vae_int8_convrot.safetensors) (3.17 GB, low VRAM) | |
| - or [minimax_h3_video_vae_fp16.safetensors](https://huggingface.co/Comfy-Org/MiniMax-H3/resolve/main/vae/minimax_h3_video_vae_fp16.safetensors) (5.21 GB) | |
| ## Model Storage Location | |
| ``` | |
| 📂 ComfyUI/ | |
| ├── 📂 models/ | |
| │ ├── 📂 diffusion_models/ | |
| │ │ └── minimax_h3_ref2va_viggle_pruned_int8_convrot.safetensors | |
| │ ├── 📂 loras/ | |
| │ │ └── viggle_animate_dmd_lora_r64.safetensors | |
| │ ├── 📂 text_cond/ | |
| │ │ └── fixed_embed_fwd_anyframe.safetensors | |
| │ └── 📂 vae/ | |
| │ └── minimax_h3_video_vae_int8_convrot.safetensors | |
| ``` | |
| ## Workflow Notes | |
| - Custom nodes required: [ComfyUI-Viggle-Animate-H3](https://github.com/Saganaki22/ComfyUI-Viggle-Animate-H3) (Viggle Animate Conditioning + Load Text Conditioning) and [ComfyUI-KJNodes](https://github.com/kijai/ComfyUI-KJNodes) (fast preview). | |
| - **Load Video**: set `frame_load_cap` equal to the conditioning node's `length` (e.g. 124) and `force_rate` to 24. | |
| - Output resolution follows the driving video by default; set the conditioning node's `width`/`height` to override (each axis rounds to 32), or pre-scale the clip with **Scale Image to Total Pixels**. Tested canvas range: **0.4–0.98 MP**. | |
| - Sampler: euler, er_sde, exp_heun_2_x0, lcm, simple, normal, beta, bong_tangent, 4-8 steps, cfg 1.0, ModelSamplingMiniMaxH3 shift 3.0. | |
| - Stacks with **Comfy Kitchen** and **block sparse attention** patches. | |
| ## Limitations | |
| - **Identity drift on re-entry**: when the subject leaves the camera view and re-enters, the re-entry settles toward the driving video's original appearance rather than the reference image. The same applies when the subject moves far from the reference pose or makes abrupt large motions (e.g. a backflip) — the further from the still, the weaker the identity hold. | |
| Base model (VAEs, audio VAE): [MiniMaxAI/MiniMax-H3](https://huggingface.co/MiniMaxAI/MiniMax-H3) · | |
| Original model & inference code: [Viggle/Viggle-Animate](https://huggingface.co/Viggle/Viggle-Animate) | |
| ## Citation | |
| ```bibtex | |
| @misc{viggle2026animate, | |
| title = {Viggle-Animate: Character Replacement in Video from a Single Repainted Frame}, | |
| author = {Viggle Research}, | |
| year = {2026}, | |
| url = {https://huggingface.co/Viggle/Viggle-Animate} | |
| } | |
| ``` | |
| ## License | |
| The weights are a Model Derivative of MiniMax H3 — the | |
| [MiniMax H3 Community License Agreement](https://huggingface.co/MiniMaxAI/MiniMax-H3) applies to | |
| them, including these converted/quantized variants. Read it before redistributing or shipping a | |
| product on them. Do not run the model on people who have not consented, and label generated | |
| output as AI-generated. | |
| ## Report Issue | |
| - Weights/conversion issues: [ComfyUI-Viggle-Animate-H3/issues](https://github.com/Saganaki22/ComfyUI-Viggle-Animate-H3/issues) | |
Xet Storage Details
- Size:
- 6.09 kB
- Xet hash:
- 1544c829eab63b28a1d26a608da3eed5a38db94c31566f95385f42eb08060bba
·
Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.