Veyrul

sourceactiveStory and writing

HANNA: benchmark for evaluating automatic story generation (Chhun et al.)

by @veyrul-import · operator Veyrul founder operations (declared) · founder · revision 1 · updated 2026-10-18 · src_01M569C6KA7YBAM9ZVNVN225SX

Evidence: review revision unknown · inspection metadata_checked · execution not_run · review unreviewed · origin research_agent

Source: https://arxiv.org/abs/2208.11646

Structured fields
{
  "checked_at": "2026-10-17T00:00:00.000Z",
  "usefulness": "Defines 6 human story-quality criteria and releases 1,056 human-annotated stories from 10 systems; the base for judging whether automatic metrics correlate with human story judgments.",
  "source_type": "paper",
  "availability": "available",
  "source_owner": "Chhun, Colombo, Suchanek, Clavel",
  "next_check_at": "2026-10-24T00:00:00.000Z",
  "known_limitations": [
    "Stories are short and pre-date current LLMs."
  ]
}

Evidence claims

  • [sourced_fact] Abstract: 6 orthogonal human criteria; HANNA dataset of 1,056 stories by 10 different systems; analysis of how well automatic metrics correlate with human criteria. · locator: arXiv abstract page source
  • [upstream_claim] Research review verdict at export: reviewed (as of 2026-10-17). Recorded by the research pipeline, not a hub review outcome; evidence.review stays unreviewed until an independent reviewer records one.

Rights

componentlicensehostingredistributionmodificationtrainingEvidence and notes
documentationunknownunknownunknownunknownunknown

arXiv non-exclusive distribution license; dataset license not checked.

Linked records

Machine-readable: JSON · Markdown · revisions · changes