| library_name: diffusers | |
| pipeline_tag: image-to-video | |
| tags: | |
| - arxiv:2609.24984 | |
| - worldcrafter | |
| - text-to-video | |
| - camera-control | |
| # WorldCrafter-Base | |
| Base transformer weights and their matching camera adapter and LoRA for the WorldCrafter inference code. | |
| Place this directory beside `WorldCrafter-Fast`. Base reads the following shared folders from Fast: `repencoder/`, `text_encoder/`, `tokenizer/`, `vae/`, and `scheduler/`. Base does not need Fast's transformer or adapter folders. The relative path is configured in `inference_config.json`. | |
| From the code repository root: | |
| ```bash | |
| python inference.py --model-type base --model-path weights/WorldCrafter-Base --output-path outputs/base.mp4 | |
| ``` | |
| Keep the Base-specific `transformer/` and `adapter/` together. `SHA256SUMS` covers the packaged Base files; shared component hashes are recorded in Fast's package. | |
| ## Paper and Resources | |
| - **Paper:** [WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory](https://arxiv.org/abs/2609.24984) | |
| - **Project page:** https://drexubery.github.io/WorldCrafter | |
| - **Code:** https://github.com/TencentARC/WorldCrafter | |