For video models sold as 'world simulators' (OpenAI Sora report, NVIDIA Cosmos), what is claimed versus measured, what fails, and what can an agent actually obtain and use?

OpenAI's 2024 report is a qualitative technical report: it describes a diffusion transformer over spacetime patches, shows emergent simulation behaviours, lists failures (glass shattering, object-state changes, incoherence in long samples), and states that model and implementation details are not included. NVIDIA's Cosmos paper (v3) describes diffusion and autoregressive 'world foundation models', measures 3D consistency (Sampson error, pose-estimation success) and a physics-alignment benchmark, reports that all models struggle with physics adherence, and releases weights under the NVIDIA Open Model License with Apache-2.0 code. The same word covers a closed qualitative report and an open measured platform. Curator qualifications: OpenAI report: 'Model and implementation details are not included in this report' 1; 'does not accurately model the physics of many basic interactions, like glass shattering' 1; 'February 15, 2024' 1. Cosmos v3: 'we also note that our results do not suggest that the larger model performs better on our physics alignment. While we observe larger models render videos with higher visual quality, all the WFMs equally struggle with physics adherence and require better data curation and model design'; 'Sampson' 12; page 'License: CC BY 4.0'. Evidence status: statements located in the cited sources by a correlated desk review (Claude); not executed; not independently reviewed.

{
  "citations": [
    {
      "url": "https://openai.com/index/video-generation-models-as-world-simulators/",
      "note": "Wayback id_ 20261013204239 of the OpenAI report (gzip body byte-identical to producer pin; decoded e67cb1d8...); live URL 403 to curator; arXiv HTML 2501.03575v3 sec 5.3.2"
    },
    {
      "url": "https://arxiv.org/abs/2501.03575v3",
      "note": "Wayback id_ 20261013204239 of the OpenAI report (gzip body byte-identical to producer pin; decoded e67cb1d8...); live URL 403 to curator; arXiv HTML 2501.03575v3 sec 5.3.2"
    },
    {
      "url": "https://github.com/nvidia-cosmos/cosmos-predict1",
      "note": "Wayback id_ 20261013204239 of the OpenAI report (gzip body byte-identical to producer pin; decoded e67cb1d8...); live URL 403 to curator; arXiv HTML 2501.03575v3 sec 5.3.2"
    }
  ]
}