Any-to-Any
Transformers
Safetensors
qwen3_5
image-text-to-text
video-editing
agent
tool-use
long-horizon
reinforcement-learning
qwen3.5
Instructions to use tencent/WeVisCut with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use tencent/WeVisCut with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("tencent/WeVisCut") model = AutoModelForMultimodalLM.from_pretrained("tencent/WeVisCut", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -2,59 +2,58 @@
|
|
| 2 |
license: other
|
| 3 |
library_name: transformers
|
| 4 |
base_model: Qwen/Qwen3.5-9B
|
| 5 |
-
pipeline_tag:
|
| 6 |
tags:
|
| 7 |
-
- WeVisCut
|
| 8 |
- video-editing
|
| 9 |
-
- long-form-video
|
| 10 |
- agent
|
| 11 |
- tool-use
|
| 12 |
-
-
|
| 13 |
- reinforcement-learning
|
| 14 |
- qwen3.5
|
| 15 |
---
|
| 16 |
|
| 17 |
-
# WeVisCut
|
| 18 |
|
| 19 |
-
WeVisCut is a 9B tool-using
|
| 20 |
|
| 21 |
-
|
| 22 |
-
**Model:** [Hugging Face](https://huggingface.co/tencent/WeVisCut)
|
| 23 |
-
**Code:** [GitHub](https://github.com/Tencent/WeVisCut)
|
| 24 |
-
**Project page:** [WeVisCut](https://xd-mu.github.io/WeVisCut/)
|
| 25 |
|
| 26 |
-
|
| 27 |
|
| 28 |
-
|
| 29 |
-
|
| 30 |
-
|
| 31 |
-
|
| 32 |
-
|
| 33 |
-
|
| 34 |
-
|
|
|
|
|
|
|
|
|
|
| 35 |
|
| 36 |
-
|
| 37 |
|
| 38 |
-
|
| 39 |
|
| 40 |
-
|
| 41 |
|
| 42 |
-
## Intended
|
| 43 |
|
| 44 |
-
|
| 45 |
|
| 46 |
## Citation
|
| 47 |
|
| 48 |
-
If you use this work, please cite the paper:
|
| 49 |
-
|
| 50 |
```bibtex
|
| 51 |
-
@
|
| 52 |
-
title
|
| 53 |
-
author
|
| 54 |
-
|
|
|
|
|
|
|
|
|
|
| 55 |
}
|
| 56 |
```
|
| 57 |
|
| 58 |
## License
|
| 59 |
|
| 60 |
-
The
|
|
|
|
| 2 |
license: other
|
| 3 |
library_name: transformers
|
| 4 |
base_model: Qwen/Qwen3.5-9B
|
| 5 |
+
pipeline_tag: any-to-any
|
| 6 |
tags:
|
|
|
|
| 7 |
- video-editing
|
|
|
|
| 8 |
- agent
|
| 9 |
- tool-use
|
| 10 |
+
- long-horizon
|
| 11 |
- reinforcement-learning
|
| 12 |
- qwen3.5
|
| 13 |
---
|
| 14 |
|
| 15 |
+
# WeVisCut: A Long-Horizon Tool Agent for Edited Videos
|
| 16 |
|
| 17 |
+
**WeVisCut** is a 9B tool-using agent that turns knowledge articles or narration scripts into multi-minute edited videos. At each step, it reads the current editing state and selects one of 12 tools for planning, narration, asset retrieval, composition, inspection, or repair. It is not a standalone text-to-video model; use it with the [WeVisCut runtime](https://github.com/Tencent/WeVisCut), which executes the model's tool calls.
|
| 18 |
|
| 19 |
+
## Deploy
|
|
|
|
|
|
|
|
|
|
| 20 |
|
| 21 |
+
Requirements: Python 3.11 or later and an NVIDIA GPU with about 24 GB of memory for bf16 inference. Install a PyTorch build compatible with your CUDA version before the GPU requirements below. The setup script installs Node.js, FFmpeg, and the renderer.
|
| 22 |
|
| 23 |
+
```bash
|
| 24 |
+
git clone https://github.com/Tencent/WeVisCut.git
|
| 25 |
+
cd WeVisCut
|
| 26 |
+
pip install -r requirements.txt
|
| 27 |
+
pip install -r requirements-gpu.txt
|
| 28 |
+
bash scripts/setup_external_tools.sh
|
| 29 |
+
pip install -U "huggingface_hub[cli]"
|
| 30 |
+
hf download tencent/WeVisCut --local-dir checkpoints/weviscut-9b
|
| 31 |
+
bash run_studio.sh
|
| 32 |
+
```
|
| 33 |
|
| 34 |
+
Open `http://<host>:8081/` to use the Studio. For UI-only mode without loading model weights, run `bash run_studio.sh --no-model`.
|
| 35 |
|
| 36 |
+
## Model
|
| 37 |
|
| 38 |
+
The policy is based on Qwen3.5-9B and is trained on executable editing trajectories. Its runtime provides an editable timeline with pause/resume, manual and chat-based revisions, per-shot rerendering, and version rollback. Video quality depends on the configured retrieval, TTS, and rendering services and available templates.
|
| 39 |
|
| 40 |
+
## Intended Use and Limitations
|
| 41 |
|
| 42 |
+
WeVisCut is intended for research and production assistance in long-form video editing. It does not guarantee factual accuracy or production quality; review generated narration and video before publication. The model weights require the WeVisCut tool environment to produce a video.
|
| 43 |
|
| 44 |
## Citation
|
| 45 |
|
|
|
|
|
|
|
| 46 |
```bibtex
|
| 47 |
+
@misc{weviscut2026,
|
| 48 |
+
title = {WeVisCut: A Long-Horizon Tool Agent for Turning Knowledge Articles into Edited Videos},
|
| 49 |
+
author = {WeVisCut Team},
|
| 50 |
+
organization = {Tencent},
|
| 51 |
+
year = {2026},
|
| 52 |
+
howpublished = {\url{https://xd-mu.github.io/WeVisCut/}},
|
| 53 |
+
note = {Technical report and code release}
|
| 54 |
}
|
| 55 |
```
|
| 56 |
|
| 57 |
## License
|
| 58 |
|
| 59 |
+
The WeVisCut code is released under the [Apache License 2.0](https://github.com/Tencent/WeVisCut/blob/main/LICENSE). Model weights and third-party components are subject to their respective license terms.
|