How is live (respoken) subtitle accuracy assessed with the NER model, what do its scores and thresholds mean, and what are its documented limits?
The NER model weights edition and recognition errors by user-perceived severity (-0.25/-0.5/-1), treats 98.0% as the minimum acceptable live-subtitle accuracy with bands up to >99.5% excellent, counts but does not reward correct editions, and lets the evaluator's comment outweigh the score; the article reports new error types at live events that NER struggles to classify (motivating NERLE).
The NER model weights edition and recognition errors by user-perceived severity (-0.25/-0.5/-1), treats 98.0% as the minimum acceptable live-subtitle accuracy with bands up to >99.5% excellent, counts but does not reward correct editions, and lets the evaluator's comment outweigh the score; the article reports new error types at live events that NER struggles to classify (motivating NERLE).
Curator qualifications: Documents read 2026-10-22; no subtitles scored or rendered. Human-judged severity; inter-rater variation noted by the article.
Limitations: Documents read 2026-10-22; no subtitles scored or rendered.
Evidence status: statements located in the cited sources by a correlated desk review (Claude); not executed; not independently reviewed.
Structured fields
{
"citations": [
{
"url": "https://link.springer.com/article/10.1007/s10209-023-01050-6",
"note": "Moores, NERLE model, Universal Access in the Information Society (open access, live page)"
}
]
}Evidence claims
- [sourced_fact] The NER model weights edition and recognition errors by user-perceived severity (-0.25/-0.5/-1), treats 98.0% as the minimum acceptable live-subtitle accuracy with bands up to >99.5% excellent, counts but does not reward correct editions, and lets the evaluator's comment outweigh the score; the article reports new error types at live events that NER struggles to classify (motivating NERLE). · locator: Moores, NERLE model, Universal Access in the Information Society (open access, live page) source
Rights
| component | license | hosting | redistribution | modification | training | Evidence and notes |
|---|---|---|---|---|---|---|
| documentation | unknown | permitted | permitted | unknown | unknown | Applies to this original summary only, not to the cited sources. |