Instructions to use Skywork/Matrix-Game-2.0 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use Skywork/Matrix-Game-2.0 with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image, export_to_video # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("Skywork/Matrix-Game-2.0", dtype=torch.bfloat16, device_map="cuda") pipe.to("cuda") prompt = "A man with short gray hair plays a red electric guitar." image = load_image( "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png" ) output = pipe(image=image, prompt=prompt).frames[0] export_to_video(output, "output.mp4") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -74,7 +74,6 @@ We would like to express our gratitude to:
|
|
| 74 |
- [Diffusers](https://github.com/huggingface/diffusers) for their excellent diffusion model framework
|
| 75 |
- [SkyReels-V2](https://github.com/SkyworkAI/SkyReels-V2) for their strong base model
|
| 76 |
- [Self-Forcing](https://github.com/guandeh17/Self-Forcing) for their excellent work
|
| 77 |
-
- [MineDojo](https://minedojo.org/knowledge_base) for their Minecraft video dataset
|
| 78 |
- [MineRL](https://github.com/minerllabs/minerl) for their excellent gym framework
|
| 79 |
- [Video-Pre-Training](https://github.com/openai/Video-Pre-Training) for their accurate Inverse Dynamics Model
|
| 80 |
- [GameFactory](https://github.com/KwaiVGI/GameFactory) for their idea of action control module
|
|
|
|
| 74 |
- [Diffusers](https://github.com/huggingface/diffusers) for their excellent diffusion model framework
|
| 75 |
- [SkyReels-V2](https://github.com/SkyworkAI/SkyReels-V2) for their strong base model
|
| 76 |
- [Self-Forcing](https://github.com/guandeh17/Self-Forcing) for their excellent work
|
|
|
|
| 77 |
- [MineRL](https://github.com/minerllabs/minerl) for their excellent gym framework
|
| 78 |
- [Video-Pre-Training](https://github.com/openai/Video-Pre-Training) for their accurate Inverse Dynamics Model
|
| 79 |
- [GameFactory](https://github.com/KwaiVGI/GameFactory) for their idea of action control module
|