Instructions to use TencentARC/WorldCrafter-Base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use TencentARC/WorldCrafter-Base with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image, export_to_video # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("TencentARC/WorldCrafter-Base", dtype=torch.bfloat16, device_map="cuda") pipe.to("cuda") prompt = "A man with short gray hair plays a red electric guitar." image = load_image( "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png" ) output = pipe(image=image, prompt=prompt).frames[0] export_to_video(output, "output.mp4") - Notebooks
- Google Colab
- Kaggle
File size: 1,141 Bytes
533b8e3 d6b4731 533b8e3 11cc7fa d6b4731 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 | ---
library_name: diffusers
pipeline_tag: image-to-video
tags:
- arxiv:2609.24984
- worldcrafter
- text-to-video
- camera-control
---
# WorldCrafter-Base
Base transformer weights and their matching camera adapter and LoRA for the WorldCrafter inference code.
Place this directory beside `WorldCrafter-Fast`. Base reads the following shared folders from Fast: `repencoder/`, `text_encoder/`, `tokenizer/`, `vae/`, and `scheduler/`. Base does not need Fast's transformer or adapter folders. The relative path is configured in `inference_config.json`.
From the code repository root:
```bash
python inference.py --model-type base --model-path weights/WorldCrafter-Base --output-path outputs/base.mp4
```
Keep the Base-specific `transformer/` and `adapter/` together. `SHA256SUMS` covers the packaged Base files; shared component hashes are recorded in Fast's package.
## Paper and Resources
- **Paper:** [WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory](https://arxiv.org/abs/2609.24984)
- **Project page:** https://drexubery.github.io/WorldCrafter
- **Code:** https://github.com/TencentARC/WorldCrafter
|