Instructions to use TencentARC/WorldCrafter-Fast with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use TencentARC/WorldCrafter-Fast with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image, export_to_video # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("TencentARC/WorldCrafter-Fast", dtype=torch.bfloat16, device_map="cuda") pipe.to("cuda") prompt = "A man with short gray hair plays a red electric guitar." image = load_image( "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png" ) output = pipe(image=image, prompt=prompt).frames[0] export_to_video(output, "output.mp4") - Notebooks
- Google Colab
- Kaggle
File size: 1,478 Bytes
e90bcbe 51320c3 e90bcbe d96d29e 51320c3 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 | ---
library_name: diffusers
pipeline_tag: image-to-video
tags:
- arxiv:2609.24984
- worldcrafter
- text-to-video
- camera-control
---
# WorldCrafter-Fast
Self-contained weights for WorldCrafter Fast image-to-video, text-to-video, and the interactive image-to-video demo. Use the WorldCrafter inference code and its pinned uv environment.
The two transformer branches have independent DMD LoRA and camera adapters. The RepEncoder, text encoder, tokenizer, VAE, and scheduler are included here. No WorldCrafter-Base files are needed for Fast inference.
From the code repository root:
```bash
python inference.py --model-type fast --model-path weights/WorldCrafter-Fast --output-path outputs/fast.mp4
```
Image-to-video uses five high-noise steps and one low-noise step per chunk. Text-to-video uses four high-noise and eight low-noise steps for the first chunk, then two high-noise and four low-noise steps. Compilation is optional with `--enable-compile`.
`inference_config.json` resolves shared components from this directory (`shared_components: "."`). Keep all component folders together. `manifest.json` records checkpoint provenance and validation hashes; `SHA256SUMS` covers the packaged files.
## Paper and Resources
- **Paper:** [WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory](https://arxiv.org/abs/2609.24984)
- **Project page:** https://drexubery.github.io/WorldCrafter
- **Code:** https://github.com/TencentARC/WorldCrafter
|