What preprocessing limits and licence apply to Wan-Animate when an actor video drives a character image?
Problem: the open Wan-Animate model needs pose and face streams extracted from the actor video, and mismatches cause artifacts. Conditions: Wan2.2 repo; animation mode (character mimics actor) or replacement mode (character replaces the person in the video). Method: preprocessing outputs src_pose.mp4 and src_face.mp4, plus src_bg.mp4 and src_mask.mp4 in replacement mode; the paper abstract says body motion is replicated with skeleton signals and expressions with implicit facial features. In animation mode, enable retargeting when body proportions differ, and check the preprocessing results before generation. In replacement mode retargeting is off by default. Failure modes: significant body-proportion mismatch can cause deformation; mask extraction targets single-person videos and can fail with several people; a lower fps setting can cause choppiness. Rights: weights are Apache 2.0, with a use clause barring content that violates laws or harms individuals. Limitations: not run by me....
Structured fields
{
"citations": [
{
"url": "https://raw.githubusercontent.com/Wan-Video/Wan2.2/main/wan/modules/animate/preprocess/UserGuider.md",
"note": "1.1 Animation Mode; 1.2 Replacement Mode; Abstract; License Agreement; 2.1 Basic Usage"
},
{
"url": "https://arxiv.org/abs/2509.14055",
"note": "1.1 Animation Mode; 1.2 Replacement Mode; Abstract; License Agreement; 2.1 Basic Usage"
},
{
"url": "https://raw.githubusercontent.com/Wan-Video/Wan2.2/main/README.md",
"note": "1.1 Animation Mode; 1.2 Replacement Mode; Abstract; License Agreement; 2.1 Basic Usage"
}
]
}Evidence claims
- [sourced_fact] Problem: the open Wan-Animate model needs pose and face streams extracted from the actor video, and mismatches cause artifacts. Conditions: Wan2.2 repo; animation mode (character mimics actor) or replacement mode (character replaces the person in the video). Method: preprocessing outputs src_pose.mp4 and src_face.mp4, plus src_bg.mp4 and src_mask.mp4 in replacement mode; the paper abstract says body motion is replicated with skeleton signals and expressions with implicit facial features. In animation mode, enable retargeting when body proportions differ, and check the preprocessing results before generation. In replacement mode retargeting is off by default. Failure modes: significant body-proportion mismatch can cause deformation; mask extraction targets single-person videos and can fail with several people; a lower fps setting can cause choppiness. Rights: weights are Apache 2.0, with a use clause barring content that violates laws or harms individuals. Limitations: not run by me. Version/date: README and guide fetched at stamp; arXiv v1 dated 17 Sep 2025. · locator: 1.1 Animation Mode; 1.2 Replacement Mode; Abstract; License Agreement; 2.1 Basic Usage source
Rights
| component | license | hosting | redistribution | modification | training | Evidence and notes |
|---|---|---|---|---|---|---|
| documentation | unknown | permitted | permitted | unknown | unknown | Applies to this original summary only, not to the cited sources. |