Instructions to use amd/Micro-World-2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use amd/Micro-World-2 with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("amd/Micro-World-2", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
Update checkpoint README
Browse files
README.md
CHANGED
|
@@ -4,19 +4,19 @@ license: openrail
|
|
| 4 |
|
| 5 |
# Micro-World 2.0
|
| 6 |
|
| 7 |
-
Action-controlled causal world-model checkpoints. Micro-World 2.0 generates 352×640 video from a first frame, a text prompt, and keyboard/mouse actions. The distilled student denoises each chunk in 4 steps
|
| 8 |
|
| 9 |
-
|
| 10 |
|
| 11 |
## Checkpoints
|
| 12 |
|
| 13 |
| Path | What it is |
|
| 14 |
| --- | --- |
|
| 15 |
-
| `causal-forcing-init/model.pt` |
|
| 16 |
| `causal-lora/lora_diffusion_pytorch_model.safetensors` | Causal LoRA. Adapts the backbone to open-domain 352×640 video. |
|
| 17 |
| `action/` | Action module. Inference reads `action_preprocess` and `action_adaLN_modulation` from this checkpoint. |
|
| 18 |
| `dmd-lora/lora_diffusion_pytorch_model.safetensors` | DMD student LoRA used for 4-step generation. |
|
| 19 |
-
| `light_vae/` | Optional TurboVAED decoder from [amd/HummingbirdXT](https://huggingface.co/amd/HummingbirdXT/tree/main/vae/wan22_v1_tiling_16_12). Faster decode with
|
| 20 |
|
| 21 |
## Load order
|
| 22 |
|
|
@@ -26,6 +26,4 @@ Action-controlled causal world-model checkpoints. Micro-World 2.0 generates 352
|
|
| 26 |
4. `action`
|
| 27 |
5. `dmd-lora`
|
| 28 |
|
| 29 |
-
Chunk size is 3, the local attention window is 21, and the sink size is 1.
|
| 30 |
-
|
| 31 |
Training and inference code: [Micro-World](https://github.com/AMD-AGI/Micro-World).
|
|
|
|
| 4 |
|
| 5 |
# Micro-World 2.0
|
| 6 |
|
| 7 |
+
Action-controlled causal world-model checkpoints. Micro-World 2.0 generates 352×640 video from a first frame, a text prompt, and keyboard/mouse actions. The distilled student denoises each chunk in 4 steps.
|
| 8 |
|
| 9 |
+
The Wan2.2-TI2V-5B base weights are not in this repository; download them from [Wan-AI/Wan2.2-TI2V-5B](https://huggingface.co/Wan-AI/Wan2.2-TI2V-5B).
|
| 10 |
|
| 11 |
## Checkpoints
|
| 12 |
|
| 13 |
| Path | What it is |
|
| 14 |
| --- | --- |
|
| 15 |
+
| `causal-forcing-init/model.pt` | Causal-forcing initialization. Loaded onto the Wan2.2 transformer before the LoRAs. |
|
| 16 |
| `causal-lora/lora_diffusion_pytorch_model.safetensors` | Causal LoRA. Adapts the backbone to open-domain 352×640 video. |
|
| 17 |
| `action/` | Action module. Inference reads `action_preprocess` and `action_adaLN_modulation` from this checkpoint. |
|
| 18 |
| `dmd-lora/lora_diffusion_pytorch_model.safetensors` | DMD student LoRA used for 4-step generation. |
|
| 19 |
+
| `light_vae/` | Optional TurboVAED decoder from [amd/HummingbirdXT](https://huggingface.co/amd/HummingbirdXT/tree/main/vae/wan22_v1_tiling_16_12). Faster decode with few loss of fidelity. Omit it to use the Wan VAE. |
|
| 20 |
|
| 21 |
## Load order
|
| 22 |
|
|
|
|
| 26 |
4. `action`
|
| 27 |
5. `dmd-lora`
|
| 28 |
|
|
|
|
|
|
|
| 29 |
Training and inference code: [Micro-World](https://github.com/AMD-AGI/Micro-World).
|