Before I compare nuScenes FID/FVD scores of two driving world-model papers, what exactly should I check, and which concrete mismatches have already happened with DriveDreamer baselines?

Six checks, each with a documented case in the papers read: (1) pin the arXiv version of the citing and the cited paper, because DriveDreamer v1 and v2 print different FID/FVD for the same method; (2) read the row condition, not only the method name, because DriveDreamer-2 quotes three different DriveDreamer pairs in one table; (3) check the metric protocol (resolution, clips, frames, FVD feature extractor), which differs across papers; (4) check whether a baseline row is quoted or recomputed (Delphi marks recomputed rows with a star and gets MagicDrive FID 46.18 against the quoted 16.20); (5) check column order and rounding (Panacea lists FVD before FID; 16.96 appears as 16.9); (6) check whether the citing paper's own numbers changed between versions (UniMLVG 8.8/60.1 in v1-v2, 5.8/36.1 in v3). This is a reading checklist for reported numbers; no new scoring was done. Curator qualifications: 24 excerpts located; 2 table-row misses are LaTeX-markup artefacts. Curator confirmed the central case: DriveDreamer v1 Table 1 prints 52.6/452.0 and v2 Table 2 prints 14.9/340.8 for the same full-condition row (the table captions also differ: v1 'Action conditioned video generation performance', v2 'Comparison of generation quality on nuScenes'). Evidence status: statements located in the cited sources by a correlated desk review (Claude); not executed; not independently reviewed.

{
  "citations": [
    {
      "url": "https://arxiv.org/abs/2309.09777v1",
      "note": "Table 1; Table 2"
    },
    {
      "url": "https://arxiv.org/abs/2309.09777v2",
      "note": "Table 1; Table 2"
    },
    {
      "url": "https://arxiv.org/abs/2309.09777",
      "note": "Table 1; Table 2"
    },
    {
      "url": "https://arxiv.org/abs/2403.06845v2",
      "note": "Table 1; Table 2"
    },
    {
      "url": "https://arxiv.org/abs/2311.17918v1",
      "note": "Table 1; Table 2"
    },
    {
      "url": "https://arxiv.org/abs/2403.09630v2",
      "note": "Table 1; Table 2"
    },
    {
      "url": "https://arxiv.org/abs/2412.04842v3",
      "note": "Table 1; Table 2"
    },
    {
      "url": "https://arxiv.org/abs/2406.01349v3",
      "note": "Table 1; Table 2"
    },
    {
      "url": "https://arxiv.org/abs/2311.16813v1",
      "note": "Table 1; Table 2"
    },
    {
      "url": "https://arxiv.org/abs/2412.04842v2",
      "note": "Table 1; Table 2"
    }
  ]
}