Which adherence and temporal-consistency metrics do the Cosmos-Transfer, VACE, RealMaster and Enhancing Photorealism Enhancement papers report, and can their numbers be compared?
Adherence is reported only by the Cosmos-Transfer papers (control re-extraction metrics: Blur SSIM, Edge F1, depth si-RMSE, mask mIoU). Temporal consistency is reported by VACE and RealMaster through VBench Temporal Flickering/Motion Smoothness, and by Transfer2.5 as a DOVER-based error-accumulation curve; the Transfer1 paper text read defines no temporal-consistency metric. The same Transfer1-7B configuration scores differently in the Transfer1 paper (TransferBench) and the Cosmos 2.5 report (PAIBench-Transfer), so numbers do not carry across papers.
Adherence is reported only by the Cosmos-Transfer papers (control re-extraction metrics: Blur SSIM, Edge F1, depth si-RMSE, mask mIoU). Temporal consistency is reported by VACE and RealMaster through VBench Temporal Flickering/Motion Smoothness, and by Transfer2.5 as a DOVER-based error-accumulation curve; the Transfer1 paper text read defines no temporal-consistency metric. The same Transfer1-7B configuration scores differently in the Transfer1 paper (TransferBench) and the Cosmos 2.5 report (PAIBench-Transfer), so numbers do not carry across papers.
Curator qualifications: All excerpts located. Same-system different-number conflict (Transfer1-7B quality 8.54 vs 9.24; Edge F1 0.28 vs 0.38 across benchmarks) kept.
Evidence status: statements located in the cited sources by a correlated desk review (Claude); not executed; not independently reviewed.
Structured fields
{
"citations": [
{
"url": "https://arxiv.org/abs/2503.14492v2",
"note": "candidate evidence excerpts"
},
{
"url": "https://arxiv.org/abs/2511.00062v2",
"note": "candidate evidence excerpts"
},
{
"url": "https://arxiv.org/abs/2503.07598v2",
"note": "candidate evidence excerpts"
},
{
"url": "https://arxiv.org/abs/2603.23462v1",
"note": "candidate evidence excerpts"
},
{
"url": "https://arxiv.org/abs/2105.04619v1",
"note": "candidate evidence excerpts"
}
]
}Evidence claims
- [sourced_fact] Adherence is reported only by the Cosmos-Transfer papers (control re-extraction metrics: Blur SSIM, Edge F1, depth si-RMSE, mask mIoU). Temporal consistency is reported by VACE and RealMaster through VBench Temporal Flickering/Motion Smoothness, and by Transfer2.5 as a DOVER-based error-accumulation curve; the Transfer1 paper text read defines no temporal-consistency metric. The same Transfer1-7B configuration scores differently in the Transfer1 paper (TransferBench) and the Cosmos 2.5 report (PAIBench-Transfer), so numbers do not carry across papers. · locator: candidate evidence excerpts source
Rights
| component | license | hosting | redistribution | modification | training | Evidence and notes |
|---|---|---|---|---|---|---|
| documentation | unknown | permitted | permitted | unknown | unknown | Applies to this original summary only, not to the cited sources. |