What tasks does Wan VACE cover (reference-to-video, video editing, masked editing, expand), what inputs does it take, and which base-model licences apply?
Problem. One toolchain for video control tasks that otherwise need separate models. Conditions. VACE built on Wan2.1 (1.3B at about 81x480x832, 14B at about 81x720x1280) and LTX-Video 0.9. Method. VACE takes a text prompt plus optional video, mask and reference images; tasks include reference-to-video (R2V), video-to-video (V2V) and masked video-to-video (MV2V), which the README markets as Move-Anything, Swap-Anything, Reference-Anything, Expand-Anything and Animate-Anything. Run through vace_pipeline.py with a preprocessor task name, e.g. --task depth for V2V depth control or --task inpainting --mode bbox --bbox x1,y1,x2,y2 for masked editing; or preprocess into src_video, src_mask, src_ref_images and call vace_wan_inference.py. Prompt extension is needed for LTX-Video and English-language Wan2.1 to unlock full performance, but in editing tasks check the expanded text still matches the unseen input video. Failure modes. The README warns prompt extension may not match the video bein...
Structured fields
{
"citations": [
{
"url": "https://raw.githubusercontent.com/ali-vilab/VACE/main/README.md",
"note": "intro; Inference; Pipeline example; Models table; Models table; Models table; Notes"
}
]
}Evidence claims
- [sourced_fact] Problem. One toolchain for video control tasks that otherwise need separate models. Conditions. VACE built on Wan2.1 (1.3B at about 81x480x832, 14B at about 81x720x1280) and LTX-Video 0.9. Method. VACE takes a text prompt plus optional video, mask and reference images; tasks include reference-to-video (R2V), video-to-video (V2V) and masked video-to-video (MV2V), which the README markets as Move-Anything, Swap-Anything, Reference-Anything, Expand-Anything and Animate-Anything. Run through vace_pipeline.py with a preprocessor task name, e.g. --task depth for V2V depth control or --task inpainting --mode bbox --bbox x1,y1,x2,y2 for masked editing; or preprocess into src_video, src_mask, src_ref_images and call vace_wan_inference.py. Prompt extension is needed for LTX-Video and English-language Wan2.1 to unlock full performance, but in editing tasks check the expanded text still matches the unseen input video. Failure modes. The README warns prompt extension may not match the video being edited. Limitations. The README fetched documents no quantitative limits and lists the 1.3B preview as a preview; I did not see a pose-driven preprocessor in the lines read. Rights. All VACE models inherit the licence of the base model: Apache 2.0 for Wan2.1-based releases; RAIL-M for the LTX-Video 0.9 variant. Version/date. README entries from Mar 11, 2025; fetched 2026-10-23. · locator: intro; Inference; Pipeline example; Models table; Models table; Models table; Notes source
Rights
| component | license | hosting | redistribution | modification | training | Evidence and notes |
|---|---|---|---|---|---|---|
| documentation | unknown | permitted | permitted | unknown | unknown | Applies to this original summary only, not to the cited sources. |