How does PhyGround score physics per law, how reliable is its human study, and how well does its open PhyJudge-9B judge track humans?

PhyGround (arXiv v1, 11 May 2026) pairs 250 expected-outcome prompts with 13 laws (6 solid-body, 5 fluid, 2 optical) and a 1-5 Likert human study with 459 recruited annotators (352 retained after quality control; 5,796 complete annotations before). Eight models were scored: Wan2.2-27B-A14B and Veo-3.1 tie at 3.28/5 Overall and no model reaches 3.3; solid-body contact laws (momentum, collision) are hardest, and Veo-3.1 leads fluid and optical. The authors release PhyJudge-9B (a LoRA adapter on Qwen3.5-9B); its aggregate relative bias is 3.3 percent versus 16.6 for Gemini-3.1-Pro, measured only on held-out Veo-3.1 videos. Curator qualifications: All figures verified. The rights conflict is confirmed and is real for the same work: the repository holds code, but its only LICENSE speaks of 'this dataset' under CC BY 4.0, and GitHub metadata says NOASSERTION. The PhyJudge-9B adapter states its terms are unspecified, and its base Qwen3.5-9B terms were not read. The producer's 'treat as unlicensed until clarified' is the right hold. Rights/verification notes are shown as limitations (L00 0019/ADR-0011): they restrict reuse of the cited material or record what was not verified; they are not cleared by this summary. Limitations: [component_reuse_restriction] eligible_as_record_with_rights_hold Evidence status: statements located in the cited sources by a correlated desk review (Claude); not executed; not independently reviewed.

{
  "citations": [
    {
      "url": "https://arxiv.org/abs/2605.10806v1",
      "note": "work/2605.10806v1.html PhyGround arXiv v1; repository LICENSE; PhyJudge-9B card (HTTP 200; repo ungated; sha a1a8d98e; base_model Qwen/Qwen3.5-9B)"
    },
    {
      "url": "https://github.com/NU-World-Model-Embodied-AI/PhyGround",
      "note": "work/2605.10806v1.html PhyGround arXiv v1; repository LICENSE; PhyJudge-9B card (HTTP 200; repo ungated; sha a1a8d98e; base_model Qwen/Qwen3.5-9B)"
    },
    {
      "url": "https://huggingface.co/NU-World-Model-Embodied-AI/phyjudge-9B",
      "note": "work/2605.10806v1.html PhyGround arXiv v1; repository LICENSE; PhyJudge-9B card (HTTP 200; repo ungated; sha a1a8d98e; base_model Qwen/Qwen3.5-9B)"
    },
    {
      "url": "https://phyground.github.io/",
      "note": "work/2605.10806v1.html PhyGround arXiv v1; repository LICENSE; PhyJudge-9B card (HTTP 200; repo ungated; sha a1a8d98e; base_model Qwen/Qwen3.5-9B)"
    }
  ]
}