How consistent are readers when they state a story's theme, what do openly readable empirical studies actually measure, and where does the evidence stop?
Among the openly readable full texts read here, none reports how well independent readers agree on the theme of the same text. What they report is (a) coding reliability for researchers classifying responses as literal or interpretive (84% agreement, kappa .70; kappa .82-.95 for think-aloud categories; 90% for children's lessons), (b) an instructional effect on the share of interpretive thematic statements in one small classroom study, and (c) a developmental progression in extracting a fable's lesson. Two experts' statements for the same excerpt are related but not identical, and the authors say expert readings are not definitive. The one study aimed squarely at reader variance (Kurtz & Schober 2001) was not openly readable.
Structured fields
{
"citations": [
{
"url": "https://srlevine.people.stanford.edu/sites/g/files/sbiybj25166/files/media/file/reading_research_quarterly_2014_levine.pdf",
"note": "Levine 2014 RRQ manuscript copy (equals pin); Levine & Horton 2015 Cognition and Instruction author-site PDF (equals pin); Pelletier & Beatty 2015 Frontiers in Psychology PDF (equals pin)"
},
{
"url": "https://srlevine.people.stanford.edu/sites/g/files/sbiybj25166/files/media/file/cognition_and_instruction_2015_levine.pdf",
"note": "Levine 2014 RRQ manuscript copy (equals pin); Levine & Horton 2015 Cognition and Instruction author-site PDF (equals pin); Pelletier & Beatty 2015 Frontiers in Psychology PDF (equals pin)"
},
{
"url": "https://www.frontiersin.org/journals/psychology/articles/10.3389/fpsyg.2015.01448/pdf",
"note": "Levine 2014 RRQ manuscript copy (equals pin); Levine & Horton 2015 Cognition and Instruction author-site PDF (equals pin); Pelletier & Beatty 2015 Frontiers in Psychology PDF (equals pin)"
}
]
}Evidence claims
- [sourced_fact] Among the openly readable full texts read here, none reports how well independent readers agree on the theme of the same text. What they report is (a) coding reliability for researchers classifying responses as literal or interpretive (84% agreement, kappa .70; kappa .82-.95 for think-aloud categories; 90% for children's lessons), (b) an instructional effect on the share of interpretive thematic statements in one small classroom study, and (c) a developmental progression in extracting a fable's lesson. Two experts' statements for the same excerpt are related but not identical, and the authors say expert readings are not definitive. The one study aimed squarely at reader variance (Kurtz & Schober 2001) was not openly readable. · locator: Levine 2014 RRQ manuscript copy (equals pin); Levine & Horton 2015 Cognition and Instruction author-site PDF (equals pin); Pelletier & Beatty 2015 Frontiers in Psychology PDF (equals pin) source
Rights
| component | license | hosting | redistribution | modification | training | Evidence and notes |
|---|---|---|---|---|---|---|
| documentation | unknown | permitted | permitted | unknown | unknown | Applies to this original summary only, not to the cited sources. |
Linked records
- cites → https://srlevine.people.stanford.edu/sites/g/files/sbiybj25166/files/media/file/cognition_and_instruction_2015_levine.pdf
- cites → https://srlevine.people.stanford.edu/sites/g/files/sbiybj25166/files/media/file/reading_research_quarterly_2014_levine.pdf
- cites → https://www.frontiersin.org/journals/psychology/articles/10.3389/fpsyg.2015.01448/pdf