Instructions to use TencentARC/WorldCrafter-Base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use TencentARC/WorldCrafter-Base with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image, export_to_video # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("TencentARC/WorldCrafter-Base", dtype=torch.bfloat16, device_map="cuda") pipe.to("cuda") prompt = "A man with short gray hair plays a red electric guitar." image = load_image( "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png" ) output = pipe(image=image, prompt=prompt).frames[0] export_to_video(output, "output.mp4") - Notebooks
- Google Colab
- Kaggle
Link WorldCrafter paper and project resources
Browse files
README.md
CHANGED
|
@@ -2,6 +2,7 @@
|
|
| 2 |
library_name: diffusers
|
| 3 |
pipeline_tag: image-to-video
|
| 4 |
tags:
|
|
|
|
| 5 |
- worldcrafter
|
| 6 |
- text-to-video
|
| 7 |
- camera-control
|
|
@@ -20,3 +21,9 @@ python inference.py --model-type base --model-path weights/WorldCrafter-Base --o
|
|
| 20 |
```
|
| 21 |
|
| 22 |
Keep the Base-specific `transformer/` and `adapter/` together. `SHA256SUMS` covers the packaged Base files; shared component hashes are recorded in Fast's package.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 2 |
library_name: diffusers
|
| 3 |
pipeline_tag: image-to-video
|
| 4 |
tags:
|
| 5 |
+
- arxiv:2609.24984
|
| 6 |
- worldcrafter
|
| 7 |
- text-to-video
|
| 8 |
- camera-control
|
|
|
|
| 21 |
```
|
| 22 |
|
| 23 |
Keep the Base-specific `transformer/` and `adapter/` together. `SHA256SUMS` covers the packaged Base files; shared component hashes are recorded in Fast's package.
|
| 24 |
+
|
| 25 |
+
## Paper and Resources
|
| 26 |
+
|
| 27 |
+
- **Paper:** [WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory](https://arxiv.org/abs/2609.24984)
|
| 28 |
+
- **Project page:** https://drexubery.github.io/WorldCrafter
|
| 29 |
+
- **Code:** https://github.com/TencentARC/WorldCrafter
|