README.md
2.7 KB · 61 lines · markdown Raw
1 ---
2 license: other
3 library_name: transformers
4 base_model: Qwen/Qwen3.5-9B
5 pipeline_tag: any-to-any
6 tags:
7 - video-editing
8 - agent
9 - tool-use
10 - long-horizon
11 - reinforcement-learning
12 - qwen3.5
13 ---
14
15 # WeVisCut: A Long-Horizon Tool Agent for Edited Videos
16
17 **WeVisCut** is a 9B tool-using agent that turns knowledge articles or narration scripts into multi-minute edited videos. At each step, it reads the current editing state and selects one of 12 tools for planning, narration, asset retrieval, composition, inspection, or repair. It is not a standalone text-to-video model; use it with the [WeVisCut runtime](https://github.com/Tencent/WeVisCut), which executes the model's tool calls.
18
19 ## Deploy
20
21 Requirements: Python 3.11 or later and an NVIDIA GPU with about 24 GB of memory for bf16 inference. Install a PyTorch build compatible with your CUDA version before the GPU requirements below. The setup script installs Node.js, FFmpeg, and the renderer.
22
23 ```bash
24 git clone https://github.com/Tencent/WeVisCut.git
25 cd WeVisCut
26 pip install -r requirements.txt
27 pip install -r requirements-gpu.txt
28 bash scripts/setup_external_tools.sh
29 pip install -U "huggingface_hub[cli]"
30 hf download tencent/WeVisCut --local-dir checkpoints/weviscut-9b
31 bash run_studio.sh
32 ```
33
34 Open `http://<host>:8081/` to use the Studio. For UI-only mode without loading model weights, run `bash run_studio.sh --no-model`.
35
36 ## Model
37
38 The policy is based on Qwen3.5-9B and is trained on executable editing trajectories. Its runtime provides an editable timeline with pause/resume, manual and chat-based revisions, per-shot rerendering, and version rollback. Video quality depends on the configured retrieval, TTS, and rendering services and available templates.
39
40 ## Intended Use and Limitations
41
42 WeVisCut is intended for research and production assistance in long-form video editing. It does not guarantee factual accuracy or production quality; review generated narration and video before publication. The model weights require the WeVisCut tool environment to produce a video.
43
44 ## Citation
45
46 ```bibtex
47 @misc{mu2026weviscuteditingroomagent,
48 title={WeVisCut: The Whole Editing Room in One Agent From Narration to Long-Form Video},
49 author={Chenyu Mu and Wenming Weng and Qinrui Wang and Xingsong Ye and Hao Yu and Jun He and Chong Sun and Chen Li and Jing Lyu and Erkun Yang and Cheng Deng},
50 year={2026},
51 eprint={2610.38352},
52 archivePrefix={arXiv},
53 primaryClass={cs.CV},
54 url={https://arxiv.org/abs/2610.38352},
55 }
56 ```
57
58 ## License
59
60 The WeVisCut code is released under the [Apache License 2.0](https://github.com/Tencent/WeVisCut/blob/main/LICENSE). Model weights and third-party components are subject to their respective license terms.
61