arXiv:2603.22977cs.CLcs.AI2026-03中稿 · submission

首个达里语虚假信息数据集,揭示虚假内容高危害性特征。

DariMis: Harm-Aware Modeling for Dari Misinformation Detection on YouTube

  • 构建达里语视频虚假信息检测数据集,标注两类维度
  • 55.9%虚假内容含中高危害,真内容仅1.0%具中高危害
  • 采用双输入编码提升虚假信息召回率7个百分点

达里语是阿富汗主要语言,使用者超千万,却未被纳入虚假信息检测研究。本文提出DariMis,首个达里语YouTube视频手动标注数据集,共9,224条视频,按信息类型(虚假、部分真实、真实)和危害等级(低、中、高)双重标注。实证发现二者结构耦合:55.9%的虚假信息具有至少中等危害潜力,而真实内容仅为1.0%。这使得信息类型分类器可作为内容审核中的隐式危害筛选工具。提出标题与描述双输入编码策略,将标题和描述分别作为BERT的两个段落输入,显式建模标题与正文间的语义关系——这是误导性信息的关键信号。消融实验显示,相比单字段拼接,该方法在虚假信息召回率上提升7.0个百分点(60.1%→67.1%),尽管整体宏平均F1仅提高0.09个百分点。对比ParsBERT与XLM-RoBERTa-base,ParsBERT表现最佳,准确率达76.60%,宏平均F1为72.77%。所有指标均报告95%置信区间,讨论结果的实际意义与统计局限。

原文摘要 · Abstract (English)

Dari, the primary language of Afghanistan, is spoken by tens of millions of people yet remains largely absent from the misinformation detection literature. We address this gap with DariMis, the first manually annotated dataset of 9,224 Dari-language YouTube videos, labeled across two dimensions: Information Type (Misinformation, Partly True, True) and Harm Level (Low, Medium, High). A central empirical finding is that these dimensions are structurally coupled, not independent: 55.9 percent of Misinformation carries at least Medium harm potential, compared with only 1.0 percent of True content. This enables Information Type classifiers to function as implicit harm-triage filters in content moderation pipelines. We further propose a pair-input encoding strategy that represents the video title and description as separate BERT segment inputs, explicitly modeling the semantic relationship between headline claims and body content, a key signal of misleading information. An ablation study against single-field concatenation shows that pair-input encoding yields a 7.0 percentage point gain in Misinformation recall (60.1 percent to 67.1 percent), the safety-critical minority class, despite modest overall macro F1 differences (0.09 percentage points). We benchmark a Dari/Farsi-specialized model (ParsBERT) against XLM-RoBERTa-base; ParsBERT achieves the best test performance with accuracy of 76.60 percent and macro F1 of 72.77 percent. Bootstrap 95 percent confidence intervals are reported for all metrics, and we discuss both the practical significance and statistical limitations of the results.

虚假信息检测达里语多模态Bert

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。