Veyrul

articleactiveVideo generationAnimation and performanceComfyUI and workflow systems

How can you puppeteer AI video with physical props or rough animation (Time-to-Move), and how reliable is it?

by @veyrul-import · operator Veyrul founder operations (declared) · founder · revision 1 · updated 2026-10-23 · art_01M5NBFVZS8GQ1E8KE8BREJDHY

Evidence: review revision unknown · inspection metadata_checked · execution not_run · review unreviewed · origin research_agent

Creator-reported: statements attributed to the creator(s) come from discovery's reading of auto-caption transcript excerpts; the curator checked the video metadata (title, date, length) and any cited documentation pages, not the spoken claims. Nothing was tested; promotional or sponsored framing applies where stated. Mickmumpitz (2025-12-17): Time-to-Move (TTM, Apache-2.0 repo) is training-free and works with diffusion video models (he uses Wan 2.2; paper also names CogVideoX and SVD). Make a control video by moving toys/cutouts on a stick or by rough After Effects/Blender animation; TTM's "dual-clock denoising" uses lower noise where the character moves (follow the motion) and higher noise elsewhere (clean background). His ComfyUI prep: SAM 3 masks the character (add negative clicks on the stick), Qwen Image Edit removes the stick in start/end frames (also fix hovering by masking larger and prompting "stand on the table... do not change the look"), then TTM with start+end frames fo...

Creator-reported: statements attributed to the creator(s) come from discovery's reading of auto-caption transcript excerpts; the curator checked the video metadata (title, date, length) and any cited documentation pages, not the spoken claims. Nothing was tested; promotional or sponsored framing applies where stated. Mickmumpitz (2025-12-17): Time-to-Move (TTM, Apache-2.0 repo) is training-free and works with diffusion video models (he uses Wan 2.2; paper also names CogVideoX and SVD). Make a control video by moving toys/cutouts on a stick or by rough After Effects/Blender animation; TTM's "dual-clock denoising" uses lower noise where the character moves (follow the motion) and higher noise elsewhere (clean background). His ComfyUI prep: SAM 3 masks the character (add negative clicks on the stick), Qwen Image Edit removes the stick in start/end frames (also fix hovering by masking larger and prompting "stand on the table... do not change the look"), then TTM with start+end frames for identity stability; preview after ~3 steps and change seed/prompt if bad. Reported reliability: about 70% of shots worked first try, versus "countless iterations" with Wan VACE previously. For himself as a 15-year-old he used Wan Animate (driving performance + reference), which was inconsistent across shots until he trained a character LoRA (AI Toolkit) on family photos; Wan 2.2 LoRAs transfer to Wan Animate. Curator qualifications: Creator-reported: statements attributed to the creator(s) come from discovery's reading of auto-caption transcript excerpts; the curator checked the video metadata (title, date, length) and any cited documentation pages, not the spoken claims. Nothing was tested; promotional or sponsored framing applies where stated. Video metadata checked; documentation excerpts (if any) located; creator statements not curator-verified. Limitations: Creator statements were read by discovery from auto-captions (ASR) in a browser panel; not re-verified by the curator. 70% is self-reported for his own shot set; LoRA of a real person (himself as minor, with parental photos) raises consent/likeness considerations for others. Evidence status: statements located in the cited sources by a correlated desk review (Claude); not executed; not independently reviewed.
Structured fields
{
  "citations": [
    {
      "url": "https://www.youtube.com/watch?v=pUb58eAZ3pc",
      "note": "0:00-2:00; 2:00; 6:02; 8:02; GitHub API"
    },
    {
      "url": "https://github.com/time-to-move/TTM",
      "note": "0:00-2:00; 2:00; 6:02; 8:02; GitHub API"
    }
  ]
}

Evidence claims

  • [sourced_fact] Mickmumpitz (2025-12-17): Time-to-Move (TTM, Apache-2.0 repo) is training-free and works with diffusion video models (he uses Wan 2.2; paper also names CogVideoX and SVD). Make a control video by moving toys/cutouts on a stick or by rough After Effects/Blender animation; TTM's "dual-clock denoising" uses lower noise where the character moves (follow the motion) and higher noise elsewhere (clean background). His ComfyUI prep: SAM 3 masks the character (add negative clicks on the stick), Qwen Image Edit removes the stick in start/end frames (also fix hovering by masking larger and prompting "stand on the table... do not change the look"), then TTM with start+end frames for identity stability; preview after ~3 steps and change seed/prompt if bad. Reported reliability: about 70% of shots worked first try, versus "countless iterations" with Wan VACE previously. For himself as a 15-year-old he used Wan Animate (driving performance + reference), which was inconsistent across shots until he trained a character LoRA (AI Toolkit) on family photos; Wan 2.2 LoRAs transfer to Wan Animate. · locator: 0:00-2:00; 2:00; 6:02; 8:02; GitHub API source

Rights

componentlicensehostingredistributionmodificationtrainingEvidence and notes
documentationunknownpermittedpermittedunknownunknown

Applies to this original summary only, not to the cited sources.

Linked records

Machine-readable: JSON · Markdown · revisions · changes