arXiv:2508.12711cs.CV2025-08AAAI被引 7

GenAI让新闻样式千变万化,导致视觉语言模型误判率飙升。

Drifting Away from Truth: GenAI-Driven News Diversity Challenges LVLM-Based Misinformation Detection

  • 用多层级偏移理论分析生成新闻多样性对模型的影响
  • 六种先进模型平均准确率下降14.8%,推理过程变得混乱
  • 适合关注AI时代假消息检测的学者与安全工程师

多模态虚假信息的泛滥正威胁公共讨论与社会信任。尽管大型视觉语言模型(LVLM)在多模态虚假信息检测(MMD)上取得进展,但生成式AI(GenAI)工具的兴起带来了新挑战:由GenAI驱动的新闻多样性,表现为内容高度变异且复杂。我们发现这种多样性引发多层级偏移,包括(1)模型层面的误判偏移,即风格变化干扰模型内部推理;(2)证据层面的偏移,即表达多样性降低检索到外部证据的质量或相关性。这些偏移显著削弱了现有基于LVLM的MMD系统的鲁棒性。为系统研究该问题,我们构建了DriftBench,一个包含16,000条新闻实例的大规模基准,覆盖六类多样化类型。设计三项评估任务:(1)多层级偏移下的真伪验证鲁棒性;(2)对GenAI生成的对抗性证据污染的敏感性;(3)多样输入下推理一致性分析。六种主流LVLM检测器实验显示,平均F1下降14.8%,推理轨迹日益不稳定,对抗性证据注入下失败更严重。研究揭示现有MMD系统存在根本性漏洞,亟需在生成式AI时代发展更稳健的方法。

原文摘要 · Abstract (English)

The proliferation of multimodal misinformation poses growing threats to public discourse and societal trust. While Large Vision-Language Models (LVLMs) have enabled recent progress in multimodal misinformation detection (MMD), the rise of generative AI (GenAI) tools introduces a new challenge: GenAI-driven news diversity, characterized by highly varied and complex content. We show that this diversity induces multi-level drift, comprising (1) model-level misperception drift, where stylistic variations disrupt a model's internal reasoning, and (2) evidence-level drift, where expression diversity degrades the quality or relevance of retrieved external evidence. These drifts significantly degrade the robustness of current LVLM-based MMD systems. To systematically study this problem, we introduce DriftBench, a large-scale benchmark comprising 16,000 news instances across six categories of diversification. We design three evaluation tasks: (1) robustness of truth verification under multi-level drift; (2) susceptibility to adversarial evidence contamination generated by GenAI; and (3) analysis of reasoning consistency across diverse inputs. Experiments with six state-of-the-art LVLM-based detectors show substantial performance drops (average F1 -14.8%) and increasingly unstable reasoning traces, with even more severe failures under adversarial evidence injection. Our findings uncover fundamental vulnerabilities in existing MMD systems and suggest an urgent need for more resilient approaches in the GenAI era.

虚假信息检测生成式AI视觉语言模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。