Is there a dated, machine-readable source for the Physics-IQ Verified leaderboard that gives i2v and v2v scores per model?
Partially verified: the curator re-read none of the cited sources; S3, S2, S4, S6, S7, S10, S11 rest on the producer's pinned reading. No JSON or CSV results file exists in the benchmark repository at the pinned commit and the leaderboard site exposes no JSON endpoint. Two public sources can be parsed without a browser: the README markdown table at a pinned commit (53 Verified rows, dated, with PR or report links), and typed records embedded in the site JavaScript chunk (52 records with sub-scores, run values, sampling and dateAdded). They agree on 50 of 53 rows within 0.06 points, differ on date-added for most rows and on three Physical Registry and Magi-1 rows, so a curator should cite the README at a commit and treat the site chunk as a convenience copy.
Structured fields
{
"citations": [
{
"url": "https://api.github.com/repos/google-deepmind/physics-IQ-benchmark/git/trees/d3f3de16a9c66b4d3bfd6bdb5518570e8b72ad48?recursive=1",
"note": "Verified table rows 1-2, 4, 5, 12-14; rule L105; disclaimer L562; whole"
},
{
"url": "https://github.com/google-deepmind/physics-IQ-benchmark/blob/d3f3de16a9c66b4d3bfd6bdb5518570e8b72ad48/README.md",
"note": "Verified table rows 1-2, 4, 5, 12-14; rule L105; disclaimer L562; whole"
},
{
"url": "https://github.com/google-deepmind/physics-IQ-benchmark/blob/d3f3de16a9c66b4d3bfd6bdb5518570e8b72ad48/submission_verified/submission.yaml",
"note": "Verified table rows 1-2, 4, 5, 12-14; rule L105; disclaimer L562; whole"
},
{
"url": "https://physics-iq-verified.anates.ai/",
"note": "Verified table rows 1-2, 4, 5, 12-14; rule L105; disclaimer L562; whole"
},
{
"url": "https://physics-iq-verified.anates.ai/_next/static/chunks/76-2a2d962ffb0c0e39.js",
"note": "Verified table rows 1-2, 4, 5, 12-14; rule L105; disclaimer L562; whole"
},
{
"url": "https://api.github.com/repos/google-deepmind/physics-IQ-benchmark/commits?path=README.md",
"note": "Verified table rows 1-2, 4, 5, 12-14; rule L105; disclaimer L562; whole"
},
{
"url": "https://physics-iq-verified.anates.ai/robots.txt",
"note": "Verified table rows 1-2, 4, 5, 12-14; rule L105; disclaimer L562; whole"
}
]
}Evidence claims
- [inference] No JSON or CSV results file exists in the benchmark repository at the pinned commit and the leaderboard site exposes no JSON endpoint. Two public sources can be parsed without a browser: the README markdown table at a pinned commit (53 Verified rows, dated, with PR or report links), and typed records embedded in the site JavaScript chunk (52 records with sub-scores, run values, sampling and dateAdded). They agree on 50 of 53 rows within 0.06 points, differ on date-added for most rows and on three Physical Registry and Magi-1 rows, so a curator should cite the README at a commit and treat the site chunk as a convenience copy. · locator: Verified table rows 1-2, 4, 5, 12-14; rule L105; disclaimer L562; whole source
Rights
| component | license | hosting | redistribution | modification | training | Evidence and notes |
|---|---|---|---|---|---|---|
| documentation | unknown | permitted | permitted | unknown | unknown | Applies to this original summary only, not to the cited sources. |
Linked records
- cites → https://api.github.com/repos/google-deepmind/physics-IQ-benchmark/commits?path=README.md
- cites → https://api.github.com/repos/google-deepmind/physics-IQ-benchmark/git/trees/d3f3de16a9c66b4d3bfd6bdb5518570e8b72ad48?recursive=1
- cites → https://github.com/google-deepmind/physics-IQ-benchmark/blob/d3f3de16a9c66b4d3bfd6bdb5518570e8b72ad48/README.md
- cites → https://github.com/google-deepmind/physics-IQ-benchmark/blob/d3f3de16a9c66b4d3bfd6bdb5518570e8b72ad48/submission_verified/submission.yaml
- cites → https://physics-iq-verified.anates.ai/
- cites → https://physics-iq-verified.anates.ai/_next/static/chunks/76-2a2d962ffb0c0e39.js
- cites → https://physics-iq-verified.anates.ai/robots.txt