arXiv:2504.16304cs.CV2025-04被引 3

构建首个多源标注的短视频有害内容数据集,助力平台内容安全研究。

MetaHarm: Harmful YouTube Video Dataset Annotated by Domain Experts, GPT-4-Turbo, and Crowdworkers

  • 三类标注者(专家、GPT-4-Turbo、众包)联合标注6万+视频
  • 涵盖6类危害:信息、仇恨、成瘾、诱导、色情、身体伤害
  • 提供多层级标签与真实标签,适配内容检测与模型训练

短视频平台如YouTube、Instagram或TikTok被数十亿用户使用,但其暴露用户于从点击诱饵到暴力、仇恨或虚假信息等各类有害内容。然而,我们对短平台上的在线危害仍缺乏全面理解与度量。为此,本文构建两个大规模多模态、多类别在线危害数据集:(1) 60,906条系统筛选的潜在有害YouTube视频;(2) 19,422条由三类标注者——训练过的领域专家、GPT-4-Turbo(基于14帧图像、缩略图和文本元数据)、以及亚马逊机械土耳其众包主工——标注的视频。标注包含两类任务:(a) 二分类(有害/无害),(b) 六类危害的多标签分类:信息、仇恨与骚扰、成瘾、点击诱饵、性相关、身体伤害。此外,数据集提供:(1) 三类标注者一致标注的真值数据,及多数标注者达成共识的数据;(2) 三类标注者独立标注的三个子集。这些数据集有望推动未来在线危害研究,支持多模态分类任务,并促进视频平台有害内容的识别与缓解。

原文摘要 · Abstract (English)

Short video platforms, such as YouTube, Instagram, or TikTok, are used by billions of users. These platforms expose users to harmful content, ranging from clickbait or physical harms to hate or misinformation. Yet, we lack a comprehensive understanding and measurement of online harm on short video platforms. Toward this end, we present two large-scale datasets of multi-modal and multi-categorical online harm: (1) 60,906 systematically selected potentially harmful YouTube videos and (2) 19,422 videos annotated by three labeling actors: trained domain experts, GPT-4-Turbo (using 14 image frames, 1 thumbnail, and text metadata), and crowdworkers (Amazon Mechanical Turk master workers). The annotated dataset includes both (a) binary classification (harmful vs. harmless) and (b) multi-label categorizations of six harm categories: Information, Hate and harassment, Addictive, Clickbait, Sexual, and Physical harms. Furthermore, the annotated dataset provides (1) ground truth data with videos annotated consistently across (a) all three actors and (b) the majority of the labeling actors, and (2) three data subsets labeled by individual actors. These datasets are expected to facilitate future work on online harm, aid in (multi-modal) classification efforts, and advance the identification and potential mitigation of harmful content on video platforms.

内容安全多模态数据集视频分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。