Can I detect clickbait YouTube videos from audience comments instead of the title or thumbnail, and how well did that work in the OVCP study?
Problem: a title/thumbnail can look fine on its own; clickbait is a mismatch with the video content. Conditions: study of YouTube videos with comment threads; labels from three human annotators by majority vote. Method: Shang et al. (arXiv 1907.07604, Notre Dame) propose OVCP, which ignores the title, thumbnail and video and uses features from the viewers' comment network (structure, linguistic features, metadata) fed to supervised classifiers. Data: 500 training videos (128 clickbait, 372 non-clickbait, about 2.8M comments) and a random test sample of 125 trending-page videos (13 clickbait, 112 non-clickbait). Measured result: best model (AdaBoost) reported accuracy 0.896, precision 0.50, recall 0.46, F1 0.48, above the baselines (e.g. VGG-16 thumbnail model F1 0.15, SPW18 F1 0.36). Failure modes: with only 13 positive test videos, one video moves recall by about 8 points; precision of 0.50 means half the flags are wrong. Limitations: 2019 data, one platform snapshot, class labels ...
Structured fields
{
"citations": [
{
"url": "https://arxiv.org/pdf/1907.07604",
"note": "Abstract; 5.1 Dataset; 5.3 Table of results"
}
]
}Evidence claims
- [sourced_fact] Problem: a title/thumbnail can look fine on its own; clickbait is a mismatch with the video content. Conditions: study of YouTube videos with comment threads; labels from three human annotators by majority vote. Method: Shang et al. (arXiv 1907.07604, Notre Dame) propose OVCP, which ignores the title, thumbnail and video and uses features from the viewers' comment network (structure, linguistic features, metadata) fed to supervised classifiers. Data: 500 training videos (128 clickbait, 372 non-clickbait, about 2.8M comments) and a random test sample of 125 trending-page videos (13 clickbait, 112 non-clickbait). Measured result: best model (AdaBoost) reported accuracy 0.896, precision 0.50, recall 0.46, F1 0.48, above the baselines (e.g. VGG-16 thumbnail model F1 0.15, SPW18 F1 0.36). Failure modes: with only 13 positive test videos, one video moves recall by about 8 points; precision of 0.50 means half the flags are wrong. Limitations: 2019 data, one platform snapshot, class labels are annotator judgement, comments only exist after publication so this detects, but does not prevent, clickbait; it says nothing about how clickbait affects views or revenue. Version/date: arXiv v2, 18 Jul 2019. · locator: Abstract; 5.1 Dataset; 5.3 Table of results source
Rights
| component | license | hosting | redistribution | modification | training | Evidence and notes |
|---|---|---|---|---|---|---|
| documentation | unknown | permitted | permitted | unknown | unknown | Applies to this original summary only, not to the cited sources. |
Linked records
- cites → https://arxiv.org/pdf/1907.07604