How well do AI-generated video detectors trained on some generators work on other generators and on compressed, cropped or watermarked video?
GenVideo (arXiv 2405.19707 v3) trains 15 model configurations (Table 2) on over a million real and generated clips and tests on a 10-generator out-of-domain set built from MSR-VTT real videos. The authors DeMamba-XCLIP-FT reaches average recall/F1/AP 0.9392/0.9020/0.9710 when trained on many generators, but only 0.7572/0.7263/0.8166 when trained on a single generator (Pika), with Sora at F1 0.43. Degradations hurt unevenly: cropping dropped its recall by 0.2244 and JPEG dropped F1 by 0.2197 while CRF=28 compression cost 0.0250 F1. Real-video false positives are not separately reported in the tables read, and the real test videos come from one source.
GenVideo (arXiv 2405.19707 v3) trains 15 model configurations (Table 2) on over a million real and generated clips and tests on a 10-generator out-of-domain set built from MSR-VTT real videos. The authors DeMamba-XCLIP-FT reaches average recall/F1/AP 0.9392/0.9020/0.9710 when trained on many generators, but only 0.7572/0.7263/0.8166 when trained on a single generator (Pika), with Sora at F1 0.43. Degradations hurt unevenly: cropping dropped its recall by 0.2244 and JPEG dropped F1 by 0.2197 while CRF=28 compression cost 0.0250 F1. Real-video false positives are not separately reported in the tables read, and the real test videos come from one source.
Curator qualifications: Verified the many- vs single-generator figures and the typo cell. Metric-label inconsistencies inside the paper are preserved.
Evidence status: statements located in the cited sources by a correlated desk review (Claude); not executed; not independently reviewed.
Structured fields
{
"citations": [
{
"url": "https://arxiv.org/abs/2405.19707v3",
"note": "Table 4/5"
},
{
"url": "https://arxiv.org/abs/2503.02857v5",
"note": "Table 4/5"
}
]
}Evidence claims
- [sourced_fact] GenVideo (arXiv 2405.19707 v3) trains 15 model configurations (Table 2) on over a million real and generated clips and tests on a 10-generator out-of-domain set built from MSR-VTT real videos. The authors DeMamba-XCLIP-FT reaches average recall/F1/AP 0.9392/0.9020/0.9710 when trained on many generators, but only 0.7572/0.7263/0.8166 when trained on a single generator (Pika), with Sora at F1 0.43. Degradations hurt unevenly: cropping dropped its recall by 0.2244 and JPEG dropped F1 by 0.2197 while CRF=28 compression cost 0.0250 F1. Real-video false positives are not separately reported in the tables read, and the real test videos come from one source. · locator: Table 4/5 source
Rights
| component | license | hosting | redistribution | modification | training | Evidence and notes |
|---|---|---|---|---|---|---|
| documentation | unknown | permitted | permitted | unknown | unknown | Applies to this original summary only, not to the cited sources. |