Does the Physics-IQ Verified leaderboard support Odyssey's claim that Odyssey-3 Pro's 66.1 is the highest reported v2v score, and under what conditions was that number produced?
Yes, narrowly. At repository commit d3f3de16 (observed 2026-10-22) and in the site records, 66.10 is the highest listed Verified video-to-video score, 0.63 above the next row (Cosmos3-Super best-of-8, 65.47), and it is not the highest for image-to-video (Odyssey-3 Pro best-of-8 54.69 vs Cosmos3-Super 55.10). The number is a single best-of-8 run with rewritten ("custom") prompts, self-submitted and merged by the repository maintainers without a stated reproduction; the highest v2v row without best-of-N is Odyssey-3 Pro prompt-enhanced at 63.37 ± 0.63, and the highest v2v row that lists any standard deviation is FLUX 3 [large] best-of-N at 64.35 ± 0.22. The repository rule for claiming SOTA asks for a 4-run standard deviation, which the 66.10 row lacks.
Structured fields
{
"citations": [
{
"url": "https://odyssey.ml/meet-odyssey-3",
"note": "Verified table rows 1-2, 4, 5, 12-14; rule L105; disclaimer L562"
},
{
"url": "https://github.com/google-deepmind/physics-IQ-benchmark/blob/d3f3de16a9c66b4d3bfd6bdb5518570e8b72ad48/README.md",
"note": "Verified table rows 1-2, 4, 5, 12-14; rule L105; disclaimer L562"
},
{
"url": "https://physics-iq-verified.anates.ai/_next/static/chunks/76-2a2d962ffb0c0e39.js",
"note": "Verified table rows 1-2, 4, 5, 12-14; rule L105; disclaimer L562"
},
{
"url": "https://github.com/google-deepmind/physics-IQ-benchmark/pull/90",
"note": "Verified table rows 1-2, 4, 5, 12-14; rule L105; disclaimer L562"
},
{
"url": "https://github.com/google-deepmind/physics-IQ-benchmark/pull/90",
"note": "Verified table rows 1-2, 4, 5, 12-14; rule L105; disclaimer L562"
}
]
}Evidence claims
- [sourced_fact] Yes, narrowly. At repository commit d3f3de16 (observed 2026-10-22) and in the site records, 66.10 is the highest listed Verified video-to-video score, 0.63 above the next row (Cosmos3-Super best-of-8, 65.47), and it is not the highest for image-to-video (Odyssey-3 Pro best-of-8 54.69 vs Cosmos3-Super 55.10). The number is a single best-of-8 run with rewritten ("custom") prompts, self-submitted and merged by the repository maintainers without a stated reproduction; the highest v2v row without best-of-N is Odyssey-3 Pro prompt-enhanced at 63.37 ± 0.63, and the highest v2v row that lists any standard deviation is FLUX 3 [large] best-of-N at 64.35 ± 0.22. The repository rule for claiming SOTA asks for a 4-run standard deviation, which the 66.10 row lacks. · locator: Verified table rows 1-2, 4, 5, 12-14; rule L105; disclaimer L562 source
Rights
| component | license | hosting | redistribution | modification | training | Evidence and notes |
|---|---|---|---|---|---|---|
| documentation | unknown | permitted | permitted | unknown | unknown | Applies to this original summary only, not to the cited sources. |
Linked records
- cites → https://github.com/google-deepmind/physics-IQ-benchmark/blob/d3f3de16a9c66b4d3bfd6bdb5518570e8b72ad48/README.md
- cites → https://github.com/google-deepmind/physics-IQ-benchmark/pull/90
- cites → https://odyssey.ml/meet-odyssey-3
- cites → https://physics-iq-verified.anates.ai/_next/static/chunks/76-2a2d962ffb0c0e39.js