I am joining AI-generated video with a separately generated audio track: what are the first checks for lip-sync drift and frame-rate offsets, and what do the sources actually support?
The sources support five first checks; the checklist itself is a worker synthesis, untested. (1) Fix one sign convention: three inspected sources use different ones. (2) Compare picture and audio durations and frame/sample rates before aligning; a conversion that retimes picture but not audio drifts linearly (worker arithmetic: 0.1% = about 60 ms per minute; 4% = about 2.4 s per minute), so measure offset at the start and the end. (3) Measure at utterance onsets and mid-utterance for speech. (4) Calibrate any automated detector with known injected offsets in both directions; the published benchmark grain is 200 ms and inputs are 25 fps. (5) If an offset must remain, leave audio slightly late rather than early (candidate 01). No inspected source measures AI-generator offsets.
Structured fields
{
"citations": [
{
"url": "https://www.ebi.ac.uk/europepmc/webservices/rest/PMC4124486/fullTextXML",
"note": "candidate evidence excerpts"
},
{
"url": "https://www.ebi.ac.uk/europepmc/webservices/rest/PMC3549984/fullTextXML",
"note": "candidate evidence excerpts"
},
{
"url": "https://github.com/v-iashin/Synchformer/blob/b66668a1521d7567cc760e5544b2b5b53179b687/README.md",
"note": "candidate evidence excerpts"
},
{
"url": "https://arxiv.org/html/2401.16423v1",
"note": "candidate evidence excerpts"
},
{
"url": "https://www.ebi.ac.uk/europepmc/webservices/rest/PMC12059004/fullTextXML",
"note": "candidate evidence excerpts"
},
{
"url": "https://www.ebi.ac.uk/europepmc/webservices/rest/PMC4117430/fullTextXML",
"note": "candidate evidence excerpts"
}
]
}Evidence claims
- [proposal] The sources support five first checks; the checklist itself is a worker synthesis, untested. (1) Fix one sign convention: three inspected sources use different ones. (2) Compare picture and audio durations and frame/sample rates before aligning; a conversion that retimes picture but not audio drifts linearly (worker arithmetic: 0.1% = about 60 ms per minute; 4% = about 2.4 s per minute), so measure offset at the start and the end. (3) Measure at utterance onsets and mid-utterance for speech. (4) Calibrate any automated detector with known injected offsets in both directions; the published benchmark grain is 200 ms and inputs are 25 fps. (5) If an offset must remain, leave audio slightly late rather than early (candidate 01). No inspected source measures AI-generator offsets. · locator: candidate evidence excerpts source
Rights
| component | license | hosting | redistribution | modification | training | Evidence and notes |
|---|---|---|---|---|---|---|
| documentation | unknown | permitted | permitted | unknown | unknown | Applies to this original summary only, not to the cited sources. |
Linked records
- cites → https://arxiv.org/html/2401.16423v1
- cites → https://github.com/v-iashin/Synchformer/blob/b66668a1521d7567cc760e5544b2b5b53179b687/README.md
- cites → https://www.ebi.ac.uk/europepmc/webservices/rest/PMC12059004/fullTextXML
- cites → https://www.ebi.ac.uk/europepmc/webservices/rest/PMC3549984/fullTextXML
- cites → https://www.ebi.ac.uk/europepmc/webservices/rest/PMC4117430/fullTextXML
- cites → https://www.ebi.ac.uk/europepmc/webservices/rest/PMC4124486/fullTextXML