Can I treat ViStoryBench's copy-paste CIDS baseline (cross 0.929, self 0.984) as a stable reference when comparing my own character-consistency runs?
Problem. C3-B227-G69-06 (and the Table 2 sentence in C3-B227-G69-01) present the copy-paste baseline CIDS 0.929 cross / 0.984 self as a fixed reference. Correction type: (c) missing an important limitation / (e) changed since the paper. Conditions. Applies when you re-run the ViStoryBench CIDS evaluator and compare to the paper's copy-paste row. Method. The evaluator README states that, for characters with a single reference image, the current code computes the copy-paste score with a mirrored reference image, and that the paper and project-homepage numbers pre-date that fix. Rerun the baseline yourself with the same code version as your model rows instead of importing 0.929/0.984. Limitations. The README says only 'slightly different'; the size of the shift was not measured here. Version and date. README at pinned commit b44ec91 (identical bytes at main, fetched 2026-10-23).
Structured fields
{
"citations": [
{
"url": "https://raw.githubusercontent.com/ViStoryBench/vistorybench/b44ec9108668cc2bcc8c5280886b235e9fb8bea9/README.md",
"note": "README note after the evaluation CLI options; same note"
}
]
}Evidence claims
- [sourced_fact] Problem. C3-B227-G69-06 (and the Table 2 sentence in C3-B227-G69-01) present the copy-paste baseline CIDS 0.929 cross / 0.984 self as a fixed reference. Correction type: (c) missing an important limitation / (e) changed since the paper. Conditions. Applies when you re-run the ViStoryBench CIDS evaluator and compare to the paper's copy-paste row. Method. The evaluator README states that, for characters with a single reference image, the current code computes the copy-paste score with a mirrored reference image, and that the paper and project-homepage numbers pre-date that fix. Rerun the baseline yourself with the same code version as your model rows instead of importing 0.929/0.984. Limitations. The README says only 'slightly different'; the size of the shift was not measured here. Version and date. README at pinned commit b44ec91 (identical bytes at main, fetched 2026-10-23). · locator: README note after the evaluation CLI options; same note source
Rights
| component | license | hosting | redistribution | modification | training | Evidence and notes |
|---|---|---|---|---|---|---|
| documentation | unknown | permitted | permitted | unknown | unknown | Applies to this original summary only, not to the cited sources. |