What does this literature support, and not support, for turning any existing video into a playable or directable world?
Synthesis, not a result. Papers support: (a) learning a small discrete or continuous control interface from unlabelled video in a domain (platformers, robot arms, rendered walkthroughs); (b) copying a motion between clips with released AdaWorld/Olaf-World-style models in the authors' tests; (c) adapting such a model to real controls with little labelled data. They do not support, by what was inspected: arbitrary film footage with cuts and moving cameras; long persistent worlds (Genie's 16-frame memory; AdaWorld's limit beyond the initial scene); named, stable player controls; rights clearance of the source video. Treat a latent-action world from existing video as a research-preview capability that must be probed per source, not assumed.
Structured fields
{
"citations": [
{
"url": "https://arxiv.org/abs/2402.15391v1",
"note": "method; conclusion; Table 2; human eval; limitations"
},
{
"url": "https://arxiv.org/abs/2503.18938v4",
"note": "method; conclusion; Table 2; human eval; limitations"
},
{
"url": "https://arxiv.org/abs/2601.05230v2",
"note": "method; conclusion; Table 2; human eval; limitations"
},
{
"url": "https://arxiv.org/abs/2602.10104v2",
"note": "method; conclusion; Table 2; human eval; limitations"
},
{
"url": "https://arxiv.org/abs/2312.10812v2",
"note": "method; conclusion; Table 2; human eval; limitations"
},
{
"url": "https://arxiv.org/abs/2605.20223v3",
"note": "method; conclusion; Table 2; human eval; limitations"
}
]
}Evidence claims
- [inference] Synthesis, not a result. Papers support: (a) learning a small discrete or continuous control interface from unlabelled video in a domain (platformers, robot arms, rendered walkthroughs); (b) copying a motion between clips with released AdaWorld/Olaf-World-style models in the authors' tests; (c) adapting such a model to real controls with little labelled data. They do not support, by what was inspected: arbitrary film footage with cuts and moving cameras; long persistent worlds (Genie's 16-frame memory; AdaWorld's limit beyond the initial scene); named, stable player controls; rights clearance of the source video. Treat a latent-action world from existing video as a research-preview capability that must be probed per source, not assumed. · locator: method; conclusion; Table 2; human eval; limitations source
Rights
| component | license | hosting | redistribution | modification | training | Evidence and notes |
|---|---|---|---|---|---|---|
| documentation | unknown | permitted | permitted | unknown | unknown | Applies to this original summary only, not to the cited sources. |