How good is the evidence that VBench-2.0 scores track human judgment, which systems does it say lead and by how much, and what judge-bias, saturation or protocol risks do the authors and repo admit or leave?

The human-alignment evidence is a model-level comparison over only four systems per dimension. I recomputed the table's 'Correlation' row as Pearson r over those four points (matches to within rounding), while the figure caption says Spearman; with n=4 rank agreement is far weaker on some dimensions (0.4 for Human Anatomy and Human Interaction, average ranks, no significance test). Several dimensions have tiny score spreads between systems, and the authors admit VLM judges are unreliable for Human Anatomy and Motion Rationality. Between arXiv v1 and v2 the Instance Preservation method and values changed for the same four systems (about 71-76% to 82-94%). Leader statements: per Table II no system leads everywhere; there is no paper aggregate, and leaderboard Total Scores were not retrievable. Curator qualifications: Curator recomputed all 18 Correlation cells from Table IV: every reported value equals Pearson r over the four systems (max difference 0.07 points, Motion Rationality 87.97 vs 88.04). Spearman over the same points would give 40-100 (e.g. Human Anatomy 40.0, Human Interaction 40.0), so the Fig. 11 caption's 'Spearman' does not describe the table. n=4 per dimension. Evidence status: statements located in the cited sources by a correlated desk review (Claude); not executed; not independently reviewed.

{
  "citations": [
    {
      "url": "https://arxiv.org/html/2503.21755v2",
      "note": "Table IV (table element 5)"
    },
    {
      "url": "https://github.com/Vchitect/VBench/tree/fd18b3d055cb0fc6f066ca90fe2c3c8cbb698490/VBench-2.0",
      "note": "Table IV (table element 5)"
    },
    {
      "url": "https://arxiv.org/html/2503.21755v1",
      "note": "Table IV (table element 5)"
    },
    {
      "url": "https://huggingface.co/spaces/Vchitect/VBench_Leaderboard",
      "note": "Table IV (table element 5)"
    },
    {
      "url": "https://vchitect.github.io/VBench-2.0-project/",
      "note": "Table IV (table element 5)"
    }
  ]
}