How do the audio-capable world-model papers measure that sound stays in sync with actions, camera motion and events, and what do they leave unmeasured?
Three different measurement designs exist. AVWM compares the audio-energy vs motion-energy cross-correlation lag and peak of generated audio with that of ground-truth audio against the true visual trajectory (simulator data, 0.15 s steps); HelixBench (1,015 clips) scores DeSync on an Event subset and a Grounding-DINO-based three-region stereo score for camera-aligned panning; MaineCoon reports an unexplained "AV-Al" column where it is behind Ovi. Each protocol scores windows or short rollouts; none of the texts read measures the delay from a user action to the sound onset.
Three different measurement designs exist. AVWM compares the audio-energy vs motion-energy cross-correlation lag and peak of generated audio with that of ground-truth audio against the true visual trajectory (simulator data, 0.15 s steps); HelixBench (1,015 clips) scores DeSync on an Event subset and a Grounding-DINO-based three-region stereo score for camera-aligned panning; MaineCoon reports an unexplained "AV-Al" column where it is behind Ovi. Each protocol scores windows or short rollouts; none of the texts read measures the delay from a user action to the sound onset.
Curator qualifications: Excerpted evidence located (one excerpt-less row); HelixWorld claims vs higher DeSync of its causal student kept.
Evidence status: statements located in the cited sources by a correlated desk review (Claude); not executed; not independently reviewed.
Structured fields
{
"citations": [
{
"url": "https://arxiv.org/abs/2512.00883v4",
"note": "candidate evidence excerpts"
},
{
"url": "https://arxiv.org/abs/2609.38123v1",
"note": "candidate evidence excerpts"
},
{
"url": "https://arxiv.org/abs/2606.17800v1",
"note": "candidate evidence excerpts"
},
{
"url": "https://arxiv.org/abs/2610.08760v1",
"note": "candidate evidence excerpts"
}
]
}Evidence claims
- [sourced_fact] Three different measurement designs exist. AVWM compares the audio-energy vs motion-energy cross-correlation lag and peak of generated audio with that of ground-truth audio against the true visual trajectory (simulator data, 0.15 s steps); HelixBench (1,015 clips) scores DeSync on an Event subset and a Grounding-DINO-based three-region stereo score for camera-aligned panning; MaineCoon reports an unexplained "AV-Al" column where it is behind Ovi. Each protocol scores windows or short rollouts; none of the texts read measures the delay from a user action to the sound onset. · locator: candidate evidence excerpts source
Rights
| component | license | hosting | redistribution | modification | training | Evidence and notes |
|---|---|---|---|---|---|---|
| documentation | unknown | permitted | permitted | unknown | unknown | Applies to this original summary only, not to the cited sources. |