arXiv:2506.02350cs.CL2025-06NeurIPS被引 11

提出新评估框架,检测并削弱虚假信息识别模型对表面线索的依赖。

Truth over Tricks: Measuring and Mitigating Shortcut Learning in Misinformation Detection

  • 区分内在诱导与外在注入两类捷径行为,构建统一评估体系。
  • 7个主流检测器在14个基准上表现大幅下降,暴露严重泛化问题。
  • 提出SMF数据增强方法,提升模型对深层语义的理解能力。

虚假信息检测模型常依赖训练数据中与虚假信息相关的表面线索(即‘捷径’),但难以适应真实世界中多样且不断演变的虚假信息。这一问题因大语言模型(LLMs)能通过简单提示生成逼真的虚假内容而加剧。本文提出TruthOverTricks,一个统一的评估范式,用于衡量虚假信息检测中的捷径学习。该范式将捷径行为分为内在诱导和外在注入两类,并在14个主流基准及两个新构建的事实性虚假信息数据集NQ-Misinfo和Streaming-Misinfo上评估了7个代表性检测器。实验证明,现有检测器在自然出现和对抗性构造的捷径面前均出现严重性能下降。为此,本文提出SMF——一种基于LLM的数据增强框架,通过重述、事实摘要和情感归一化缓解对捷径的依赖。SMF在16个基准上持续提升鲁棒性,促使模型更依赖深层语义理解而非表面线索。相关资源已开源:https://github.com/whr000001/TruthOverTricks。

原文摘要 · Abstract (English)

Misinformation detection models often rely on superficial cues (i.e., \emph{shortcuts}) that correlate with misinformation in training data but fail to generalize to the diverse and evolving nature of real-world misinformation. This issue is exacerbated by large language models (LLMs), which can easily generate convincing misinformation through simple prompts. We introduce TruthOverTricks, a unified evaluation paradigm for measuring shortcut learning in misinformation detection. TruthOverTricks categorizes shortcut behaviors into intrinsic shortcut induction and extrinsic shortcut injection, and evaluates seven representative detectors across 14 popular benchmarks, along with two new factual misinformation datasets, NQ-Misinfo and Streaming-Misinfo. Empirical results reveal that existing detectors suffer severe performance degradation when exposed to both naturally occurring and adversarially crafted shortcuts. To address this, we propose SMF, an LLM-augmented data augmentation framework that mitigates shortcut reliance through paraphrasing, factual summarization, and sentiment normalization. SMF consistently enhances robustness across 16 benchmarks, encouraging models to rely on deeper semantic understanding rather than shortcut cues. To promote the development of misinformation detectors, we have published the resources publicly at https://github.com/whr000001/TruthOverTricks.

虚假信息检测大模型数据增强鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。