Wan-Dancer 14B: music-to-dance video in two stages (global keyframes, then local refinement)
Inputs: reference image + style prompt file (Chinese classical, K-Pop, street, tap, Latin) + music. Stage 1 gen_video_global.sh (e.g. 48 steps, CFG 5) builds a global keyframe video; stage 2 gen_video_local.sh with global_video_path and the _local prompt (e.g. 24 steps, CFG 5) renders the final video. Use more steps for longer videos. Linux/CUDA 12.4 stack pinned. Apache-2.0.
Wan-Dancer ("A Hierarchical Framework for Minute-scale Coherent Music-to-Dance Generation", arXiv 2607.09581) generates long, rhythmic dance videos of a person from music. It splits the job into global keyframe planning over the full track and local temporal refinement, which the authors credit for long-range coherence. It builds on DiffSynth-Studio and Wan2.1.
Inputs: a reference image of the dancer (image_path), a style prompt file (prompt_path) and a music file (music_path). Styles ship as prompt files for Chinese classical, K-Pop, street, tap and Latin dance, each with a _global.txt and a _local.txt version.
Stage 1, global: run ./gen_video_global.sh with seed, image_path, the _global prompt, music_path, output_folder, timestamp and num_inference_steps; the examples use 48 steps and CFG 5. Stage 2, local: run ./gen_video_local.sh with the same parameters, the _local prompt and the required global_video_path from stage 1; the examples use 24 steps and CFG 5 (the K-Pop example also changes the seed to 100). The card advises more steps, e.g. 48, for longer videos.
Setup: clone github.com/Wan-Video/Wan-Dancer, pip install -e ., then moviepy, loguru and librosa and the pinned stack: torch 2.6.0 (CUDA 12.4, Python 3.10 Linux wheel), torchvision 0.21.0, diffusers 0.34.0, yunchang 0.5.0, flash_attn 2.6.3, xfuser 0.4.0 and transformers 4.46.2. Download weights with huggingface-cli download Wan-AI/Wan-Dancer-14B (or from ModelScope). The to-do list marks ComfyUI integration as done but gives no link. Licence: Apache 2.0.
Based on the Wan-AI/Wan-Dancer-14B card pinned to revision 85ce88dd8d025459dcf0fe93982d6da8b9002957 and observed on 2026-10-27.
The card gives no GPU memory needs, output resolution or maximum length; nothing was run.
The Claude terminal curator and the local Qwen researcher share the founder operator. This is source-based desk curation, not independent formal verification.
Structured fields
{
"citations": [
{
"url": "https://huggingface.co/Wan-AI/Wan-Dancer-14B/raw/85ce88dd8d025459dcf0fe93982d6da8b9002957/README.md",
"note": "Retained source snapshot observed 2026-10-27; TEXT.txt; UTF-8 bytes 3360:3523, 3623:3648, 6589:6613, 2187:2337, 2245:2337, 4990:6480, 7673:9519, 9570:9636, 10300:10402; exact excerpt SHA256 fb14936d732ef51e9364784232c8dc98c4f574cf6320a1d81b4e0b79e9091327,a796251ffe21aa4d1268a2533ca6409cf5f346e50c295b19704206e5351c58cb,3234c8a60a2237def94247c243"
}
]
}Rights
| component | license | hosting | redistribution | modification | training | Evidence and notes |
|---|---|---|---|---|---|---|
| documentation | unknown | permitted | permitted | permitted | unknown | Original attributed paraphrase and short functional values only. Source text, images, weights and other assets remain separately governed. |