Why does the leaderboard page list Odyssey-3 Pro at rank 02 while the vendor says 66.1 is the highest, and how should an agent compare rows across views?
The two statements describe different views of the same data. The page opens on image-to-video, single generation, net-improvement; there FLUX 3 [large] is first (+10.86 pp) and Odyssey-3 Pro prompt-enhanced second (+9.74 pp). The vendor's 66.1 is a best-of-8 video-to-video row that appears only when the track is v2v and best-of-N rows are shown. Recomputing from the page records, in v2v net improvement for that row is +6.99 against a track mean of 59.11 (13 displayed rows), and in i2v single generation +9.74 against 40.25. The earlier snapshot (C3-B122-W24) is the default view, because the server HTML ignores query parameters.
The two statements describe different views of the same data. The page opens on image-to-video, single generation, net-improvement; there FLUX 3 [large] is first (+10.86 pp) and Odyssey-3 Pro prompt-enhanced second (+9.74 pp). The vendor's 66.1 is a best-of-8 video-to-video row that appears only when the track is v2v and best-of-N rows are shown. Recomputing from the page records, in v2v net improvement for that row is +6.99 against a track mean of 59.11 (13 displayed rows), and in i2v single generation +9.74 against 40.25. The earlier snapshot (C3-B122-W24) is the default view, because the server HTML ignores query parameters.
Curator qualifications: The explanation (default i2v single-generation view vs a v2v best-of-8 row) is consistent with the verified README rows. The net-improvement recomputation is producer-reported (script output read, not run by the curator).
Evidence status: curator/producer inference or synthesis from the cited sources (code read, not executed, where code is cited); correlated desk review (Claude); not independently reviewed.
Structured fields
{
"citations": [
{
"url": "https://physics-iq-verified.anates.ai/_next/static/chunks/76-2a2d962ffb0c0e39.js",
"note": "whole"
},
{
"url": "https://physics-iq-verified.anates.ai/",
"note": "whole"
},
{
"url": "https://github.com/google-deepmind/physics-IQ-benchmark/pull/90",
"note": "whole"
}
]
}Evidence claims
- [inference] The two statements describe different views of the same data. The page opens on image-to-video, single generation, net-improvement; there FLUX 3 [large] is first (+10.86 pp) and Odyssey-3 Pro prompt-enhanced second (+9.74 pp). The vendor's 66.1 is a best-of-8 video-to-video row that appears only when the track is v2v and best-of-N rows are shown. Recomputing from the page records, in v2v net improvement for that row is +6.99 against a track mean of 59.11 (13 displayed rows), and in i2v single generation +9.74 against 40.25. The earlier snapshot (C3-B122-W24) is the default view, because the server HTML ignores query parameters. · locator: whole source
Rights
| component | license | hosting | redistribution | modification | training | Evidence and notes |
|---|---|---|---|---|---|---|
| documentation | unknown | permitted | permitted | unknown | unknown | Applies to this original summary only, not to the cited sources. |