arXiv:2606.03066cs.AI2026-06中稿 · ICML

通过识别多模态内容中的内在矛盾,实现对新型伪造信息的快速检测。

CORE: Conflict-Oriented Reasoning for General Multimodal Manipulation Detection

论文配图:CORE: Conflict-Oriented Reasoning for General Multimodal Manipulation Detection
图 1 · 摘自论文原文
  • 基于冲突感知构建细粒度标注数据集,提升模型对矛盾特征的捕捉能力
  • 在少样本甚至零样本下仍能有效识别未见过的伪造类型
  • 适合需要快速应对新式虚假信息的安全与内容审核场景

生成式AI的快速发展使多模态虚假信息愈发逼真且广泛传播,严重威胁公众信任与社会稳定。现有检测方法依赖特定伪造类型的模型和大规模标注数据,难以泛化到新兴伪造形式。我们发现,虚假信息的本质在于其内在矛盾——跨模态或与常识之间的语义或物理不一致。受此启发,提出冲突导向推理框架CORE,赋予多模态大语言模型(MLLMs)显式的冲突识别能力。CORE首先构建了细粒度标注的冲突归因语料库(CAC),为冲突感知训练提供数据支持。基于CAC进行冲突导向表征增强与推理,实现了鲁棒且可泛化的冲突检测,能够以少量样本甚至零样本快速适应未见伪造类型。大量实验表明,CORE优于当前最优模型。数据集与代码已公开于https://github.com/shen8424/CORE。

原文摘要 · Abstract (English)

The rapid rise of generative AI has made multimodal fake news increasingly realistic and pervasive, posing severe threats to public trust and social stability. Existing detection methods rely heavily on manipulation-specific models and large-scale labeled data, resulting in poor generalization to emerging manipulation types. We observed that the essence of manipulated misinformation lies in its intrinsic conflicts, \textbf{i.e.,} semantic or physical inconsistencies either across modalities or with common world knowledge. Inspired by this observation, we propose \textbf{C}onflict-\textbf{O}riented \textbf{RE}asoning (\textbf{CORE}) framework, an effective paradigm that learns to endows multimodal large language models (MLLMs) with explicit conflict-capturing capability. To this end, CORE first constructs the Conflict Attribution Corpus (CAC) with fine-grained annotations of conflict factors and sources, providing essential data support for subsequent conflict perception training. By performing conflict-oriented representation enhancement and reasoning based on CAC, CORE achieves robust and generalizable conflict detection, effectively and rapidly adapting to unseen manipulation types with a few samples or in even zero-shot settings. Extensive experiments demonstrate that CORE surpasses state-of-the-art models. The dataset and code are publicly available at https://github.com/shen8424/CORE.

伪造检测多模态大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。