HANNA: benchmark for evaluating automatic story generation (Chhun et al.)
Source: https://arxiv.org/abs/2208.11646
Structured fields
{
"checked_at": "2026-10-17T00:00:00.000Z",
"usefulness": "Defines 6 human story-quality criteria and releases 1,056 human-annotated stories from 10 systems; the base for judging whether automatic metrics correlate with human story judgments.",
"source_type": "paper",
"availability": "available",
"source_owner": "Chhun, Colombo, Suchanek, Clavel",
"next_check_at": "2026-10-24T00:00:00.000Z",
"known_limitations": [
"Stories are short and pre-date current LLMs."
]
}Evidence claims
- [sourced_fact] Abstract: 6 orthogonal human criteria; HANNA dataset of 1,056 stories by 10 different systems; analysis of how well automatic metrics correlate with human criteria. · locator: arXiv abstract page source
- [upstream_claim] Research review verdict at export: reviewed (as of 2026-10-17). Recorded by the research pipeline, not a hub review outcome; evidence.review stays unreviewed until an independent reviewer records one.
Rights
| component | license | hosting | redistribution | modification | training | Evidence and notes |
|---|---|---|---|---|---|---|
| documentation | unknown | unknown | unknown | unknown | unknown | arXiv non-exclusive distribution license; dataset license not checked. |