Image-to-Video
Diffusers
Safetensors
MiniMax H3
English
smd
diffusion-distillation
few-step
lora
minimax
video-generation
audio-video
8-step
reference-to-video
Instructions to use zjwfufu/SMD-MiniMax-H3-Ref2VA-8step with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use zjwfufu/SMD-MiniMax-H3-Ref2VA-8step with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image, export_to_video # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("MiniMaxAI/MiniMax-H3", dtype=torch.bfloat16, device_map="cuda") pipe.load_lora_weights("zjwfufu/SMD-MiniMax-H3-Ref2VA-8step") prompt = "A man with short gray hair plays a red electric guitar." input_image = load_image("https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png") output = pipe(image=input_image, prompt=prompt).frames[0] export_to_video(output, "output.mp4") - Inference
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
Download examples/reference_generation.json from zjwfufu/SMD-MiniMax-H3-Ref2VA-8step: direct link, hf CLI and curl.
- Browser
- Download file 1.32 kB
-
https://huggingface.co/zjwfufu/SMD-MiniMax-H3-Ref2VA-8step/resolve/main/examples/reference_generation.json
- Command line
-
hf download hf://zjwfufu/SMD-MiniMax-H3-Ref2VA-8step/examples/reference_generation.json
-
curl -L -o reference_generation.json https://huggingface.co/zjwfufu/SMD-MiniMax-H3-Ref2VA-8step/resolve/main/examples/reference_generation.json
1.32 kB
| [ | |
| { | |
| "prompt": "Full-length studio portrait of an adult man with curly dark hair, wearing a forest green overshirt over a cream T-shirt and dark jeans. Relaxed standing pose, empty hands. Plain light gray background, soft even lighting.", | |
| "seed": 1234, | |
| "height": 1024, | |
| "width": 1024, | |
| "sigmas": [ | |
| 0.999, | |
| 0.9320267290061409, | |
| 0.8044392117499536, | |
| 0.4775642604809712, | |
| 0.0 | |
| ], | |
| "output": "ref_man.png", | |
| "output_sha256": "35f1116904ab951096229ab3c592f1507c51ab25f4632493a0084f6ebd7f5d4e", | |
| "model_id": "zjwfufu/SMD-FLUX.2-Klein-4B", | |
| "variant": "teacher-9b", | |
| "steps": 4 | |
| }, | |
| { | |
| "prompt": "Full-body product photograph of a small orange and cream toy astronaut, rounded helmet with dark blue visor, large dark letters \"SMD\" across its cream chest panel, chunky gloves and boots. Standing alone, plain light gray background, soft studio lighting.", | |
| "seed": 1234, | |
| "height": 1024, | |
| "width": 1024, | |
| "sigmas": [ | |
| 0.999, | |
| 0.9320267290061409, | |
| 0.8044392117499536, | |
| 0.4775642604809712, | |
| 0.0 | |
| ], | |
| "output": "ref_astronaut.png", | |
| "output_sha256": "023a1a5479a55f1afbb27d73b0b1c98b168b53dc9395571f9f903cff238f952c", | |
| "model_id": "zjwfufu/SMD-FLUX.2-Klein-4B", | |
| "variant": "teacher-9b", | |
| "steps": 4 | |
| } | |
| ] | |