WorldMark reports a 'Response Latency' for ten released interactive world models: what does it measure, is it compute or wall-clock latency, what are its values, and how do they relate to throughput figures?
WorldMark v2 (Alaya Lab and others; not the model authors) scores 'Response Latency' as how soon the generated video's optical-flow speed reaches half its normal sustained speed after a command switch, normalised to 0-100 (higher is better). It is a content-response metric, not compute time: the paper reports no generation time or FPS, only that scoring one model on one split takes about one hour on two H200 GPUs excluding video generation. First-Person Real translational/rotational Response Latency: Matrix-Game 2.0 98.23/86.47, LingBot-World 86.56/99.20, HY-World 1.5 85.44/85.13, HY-GameCraft 1.0 90.97/51.99, Yume 1.5 40.66/77.11. Yume 1.5 has the lowest translational Response Latency here yet the highest Hz in WorldRoamBench, so the two measure different things. The v1 HTML has six models and no latency metric.
Structured fields
{
"citations": [
{
"url": "https://arxiv.org/abs/2604.21686v2",
"note": "candidate evidence excerpts"
},
{
"url": "https://arxiv.org/abs/2604.21686v1",
"note": "candidate evidence excerpts"
},
{
"url": "https://arxiv.org/abs/2606.31672v5",
"note": "candidate evidence excerpts"
}
]
}Evidence claims
- [sourced_fact] WorldMark v2 (Alaya Lab and others; not the model authors) scores 'Response Latency' as how soon the generated video's optical-flow speed reaches half its normal sustained speed after a command switch, normalised to 0-100 (higher is better). It is a content-response metric, not compute time: the paper reports no generation time or FPS, only that scoring one model on one split takes about one hour on two H200 GPUs excluding video generation. First-Person Real translational/rotational Response Latency: Matrix-Game 2.0 98.23/86.47, LingBot-World 86.56/99.20, HY-World 1.5 85.44/85.13, HY-GameCraft 1.0 90.97/51.99, Yume 1.5 40.66/77.11. Yume 1.5 has the lowest translational Response Latency here yet the highest Hz in WorldRoamBench, so the two measure different things. The v1 HTML has six models and no latency metric. · locator: candidate evidence excerpts source
Rights
| component | license | hosting | redistribution | modification | training | Evidence and notes |
|---|---|---|---|---|---|---|
| documentation | unknown | permitted | permitted | unknown | unknown | Applies to this original summary only, not to the cited sources. |