When an AI dialogue-enhancement tool sounds clean, how can a dialogue editor tell whether it has changed the words, and what do recent papers say about objective metrics and listening tests missing such changes?
Three recent arXiv papers say generative enhancers can substitute or omit phonemes while scoring well on reference-free metrics: the URGENT 2025 P.808 study reports a generative system with top DNSMOS/NISQA and high MOS but very poor phone fidelity and says ACR tests may also miss it; Yamauchi et al. say non-intrusive filtering often fails to detect such errors; Shetu et al. find limited hallucination by WER/LPS at moderate SNR but more at very low SNR. Their remedy is a content-based metric (WER, ESTOI, LPS) alongside MOS. No source tests DeepFilterNet or Resemble Enhance for this, so applying it to production dialogue tools is a proposal.
Three recent arXiv papers say generative enhancers can substitute or omit phonemes while scoring well on reference-free metrics: the URGENT 2025 P.808 study reports a generative system with top DNSMOS/NISQA and high MOS but very poor phone fidelity and says ACR tests may also miss it; Yamauchi et al. say non-intrusive filtering often fails to detect such errors; Shetu et al. find limited hallucination by WER/LPS at moderate SNR but more at very low SNR. Their remedy is a content-based metric (WER, ESTOI, LPS) alongside MOS. No source tests DeepFilterNet or Resemble Enhance for this, so applying it to production dialogue tools is a proposal.
Curator qualifications: All 18 excerpts located; URGENT 2025 phone-fidelity finding vs Shetu et al. limited-hallucination finding kept (different tasks, models, SNR).
Evidence status: statements located in the cited sources by a correlated desk review (Claude); not executed; not independently reviewed.
Structured fields
{
"citations": [
{
"url": "https://arxiv.org/abs/2507.11306v2",
"note": "candidate evidence excerpts"
},
{
"url": "https://arxiv.org/abs/2601.12254v1",
"note": "candidate evidence excerpts"
},
{
"url": "https://arxiv.org/abs/2606.02913v1",
"note": "candidate evidence excerpts"
},
{
"url": "https://arxiv.org/abs/2506.01611v1",
"note": "candidate evidence excerpts"
},
{
"url": "https://github.com/resemble-ai/resemble-enhance/blob/8e978149bfe8abab3eb77d965d579a111afdb0ff/README.md",
"note": "candidate evidence excerpts"
},
{
"url": "https://github.com/resemble-ai/resemble-enhance/issues/43",
"note": "candidate evidence excerpts"
},
{
"url": "https://arxiv.org/abs/2305.08227v1",
"note": "candidate evidence excerpts"
}
]
}Evidence claims
- [sourced_fact] Three recent arXiv papers say generative enhancers can substitute or omit phonemes while scoring well on reference-free metrics: the URGENT 2025 P.808 study reports a generative system with top DNSMOS/NISQA and high MOS but very poor phone fidelity and says ACR tests may also miss it; Yamauchi et al. say non-intrusive filtering often fails to detect such errors; Shetu et al. find limited hallucination by WER/LPS at moderate SNR but more at very low SNR. Their remedy is a content-based metric (WER, ESTOI, LPS) alongside MOS. No source tests DeepFilterNet or Resemble Enhance for this, so applying it to production dialogue tools is a proposal. · locator: candidate evidence excerpts source
Rights
| component | license | hosting | redistribution | modification | training | Evidence and notes |
|---|---|---|---|---|---|---|
| documentation | unknown | permitted | permitted | unknown | unknown | Applies to this original summary only, not to the cited sources. |
Linked records
- cites → https://arxiv.org/abs/2305.08227v1
- cites → https://arxiv.org/abs/2506.01611v1
- cites → https://arxiv.org/abs/2507.11306v2
- cites → https://arxiv.org/abs/2601.12254v1
- cites → https://arxiv.org/abs/2606.02913v1
- cites → https://github.com/resemble-ai/resemble-enhance/blob/8e978149bfe8abab3eb77d965d579a111afdb0ff/README.md
- cites → https://github.com/resemble-ai/resemble-enhance/issues/43