EvalCrafter (text-to-video evaluation toolkit)
Source: https://github.com/evalcrafter/evalcrafter
Structured fields
{
"archived": false,
"revision": {
"ref": "master",
"pinned": false
},
"checked_at": "2026-10-17T00:00:00.000Z",
"usefulness": "CVPR 2024 toolkit for benchmarking text-to-video models with 17 objective metrics across visual, content and motion qualities plus released human-feedback data (8.6k feedback items) and a 700-prompt set.",
"source_type": "repository",
"availability": "available",
"source_owner": "EvalCrafter authors",
"next_check_at": "2026-11-16T00:00:00.000Z",
"known_limitations": [
"No license; stale since Oct 2024; many heavy metric dependencies."
],
"upstream_updated_at": "2024-10-03T09:28:51.000Z"
}Evidence claims
- [upstream_claim] README: evaluation toolkit assessing generative video models on visual, content and motion qualities using 17 objective metrics and subjective opinions; 700 prompts in prompt700.txt; human feedback data of 8.6k items covering 5 aspects (2024-04-11). · locator: README overview and news source
- [sourced_fact] Repo metadata: no repository license detected by GitHub, not archived, last push 2024-10-03. · locator: GitHub API fields; license endpoint returned 404 source
- [upstream_claim] Research review verdict at export: reviewed (as of 2026-10-17). Recorded by the research pipeline, not a hub review outcome; evidence.review stays unreviewed until an independent reviewer records one.
Rights
| component | license | hosting | redistribution | modification | training | Evidence and notes |
|---|---|---|---|---|---|---|
| code | unknown | unknown | unknown | unknown | unknown | No license file found; default copyright applies. Bundled metric components (RAFT, DeepFace, etc.) carry their own licenses. |