How are character networks extracted from screenplays and novels, how accurate are the steps, and has the quality of extracted networks been evaluated?
Extraction is a pipeline (identify characters, detect interactions, build the graph) and each step is assessed separately. For screenplays, Agarwal et al. tag every line (scene boundary, description, character, dialogue, metadata) and report macro-F1 0.96 for an ML ensemble vs 0.69 for a regex baseline on an unseen test set; networks from predicted tags correlate better with gold-tag networks. For novels, Elson et al. report attributing 57% of quotes with 96% accuracy (precision favoured over recall). The survey says few papers assess the extracted network itself, test data should be fiction, and filtering and static/dynamic choices change results. All numbers are the authors' reports on their data, not rerun.
Structured fields
{
"citations": [
{
"url": "https://aclanthology.org/W14-0907.pdf",
"note": "abstract; header; author block"
},
{
"url": "https://aclanthology.org/P10-1015.pdf",
"note": "abstract; header; author block"
},
{
"url": "https://arxiv.org/html/1907.02704v2",
"note": "abstract; header; author block"
}
]
}Evidence claims
- [sourced_fact] Extraction is a pipeline (identify characters, detect interactions, build the graph) and each step is assessed separately. For screenplays, Agarwal et al. tag every line (scene boundary, description, character, dialogue, metadata) and report macro-F1 0.96 for an ML ensemble vs 0.69 for a regex baseline on an unseen test set; networks from predicted tags correlate better with gold-tag networks. For novels, Elson et al. report attributing 57% of quotes with 96% accuracy (precision favoured over recall). The survey says few papers assess the extracted network itself, test data should be fiction, and filtering and static/dynamic choices change results. All numbers are the authors' reports on their data, not rerun. · locator: abstract; header; author block source
Rights
| component | license | hosting | redistribution | modification | training | Evidence and notes |
|---|---|---|---|---|---|---|
| documentation | unknown | permitted | permitted | unknown | unknown | Applies to this original summary only, not to the cited sources. |