How does 4D Anyone create a 4D Gaussian-splat capture of a person from one phone video, and what are its limits in a ComfyUI port?

Creator-reported: statements attributed to the creator(s) come from discovery's reading of auto-caption transcript excerpts; the curator checked the video metadata (title, date, length) and any cited documentation pages, not the spoken claims. Nothing was tested; promotional or sponsored framing applies where stated. Mickmumpitz (2026-09-11) ports the 4D Anyone paper (ant-research, Apache-2.0 repo) to ComfyUI: from one (ideally tripod) vertical phone video, a 3D skeleton locks pose per frame and a fine-tuned video model generates up to ~48 consistent synthetic views (it keeps already-generated angles in context and reshuffles which views generate together: far-apart first for shape, neighbours later for smooth transitions), then gsplat trains per-frame Gaussian splats. He swapped the original skeleton code (not licensed for commercial production) for Meta SAM 3D Body (SAM License) and bundled a gsplat setup script. Settings: camera preset (high-quality vs quick 16-view), Turbo on (little quality loss), Sage Attention, low-VRAM mode under 24 GB. Limits: paper states extreme poses and loose clothing are the breaking point; his bullet-time test (jumping onto a mattress, iPhone slow-mo) mostly broke on impact; he rescued the shot with a MiniMax H3 video-to-video cleanup pass and composited in Blender (Kiri 3DGS render engine lacks splat-sequence support, so he merged splats via a script). Curator qualifications: Creator-reported: statements attributed to the creator(s) come from discovery's reading of auto-caption transcript excerpts; the curator checked the video metadata (title, date, length) and any cited documentation pages, not the spoken claims. Nothing was tested; promotional or sponsored framing applies where stated. Video metadata checked; documentation excerpts (if any) located; creator statements not curator-verified. Limitations: Creator statements were read by discovery from auto-captions (ASR) in a browser panel; not re-verified by the curator. He calls MiniMax H3 "a free open-source video model": its repo links a "MiniMax H3 Community License" on HF (open weights, custom licence; terms not read). SAM License commercial terms not read. "40" in ASR = "4D". Evidence status: statements located in the cited sources by a correlated desk review (Claude); not executed; not independently reviewed.

{
  "citations": [
    {
      "url": "https://www.youtube.com/watch?v=nYisoS5wPYQ",
      "note": "0:00-1:30; 3:00; 3:00; 4:31; GitHub API; LICENSE head"
    },
    {
      "url": "https://github.com/ant-research/4DAnyone",
      "note": "0:00-1:30; 3:00; 3:00; 4:31; GitHub API; LICENSE head"
    },
    {
      "url": "https://github.com/facebookresearch/sam-3d-body",
      "note": "0:00-1:30; 3:00; 3:00; 4:31; GitHub API; LICENSE head"
    }
  ]
}