arXiv:2606.03418cs.CV2026-06中稿 · ICML

通过分析事实与模态不一致,提升多模态假新闻检测效果

IDO: Incongruity-aware Distribution Optimization for Multimodal Fake News Detection

论文配图:IDO: Incongruity-aware Distribution Optimization for Multimodal Fake News Detection
图 1 · 摘自论文原文
  • 引入通道重加权和高斯分布建模事实不一致
  • 设计不一致对比学习捕捉跨模态语义差异
  • 适合关注假新闻检测与多模态融合的开发者

多模态假新闻检测旨在识别新闻的真实性。现有方法主要关注跨模态一致性,但未显式建模欺骗性多模态内容中的语义不一致。事实上,虚假信息常包含与事实不符的语义。为此,我们提出不一致感知分布优化(IDO),从事实不一致和模态不一致两个角度提升检测性能。针对事实不一致,采用通道重加权策略获取语义判别性嵌入,并利用高斯分布建模由事实不一致引起的不确定性关联;针对模态不一致,采用不一致对比学习来学习跨模态语义信息。实验表明,IDO达到当前最优性能。

原文摘要 · Abstract (English)

Multimodal fake news detection aims to identify the authenticity of news. Existing multimodal fake news detection methods mainly focus on cross-modal consistency, but often fail to explicitly model the semantic incongruity that characterizes deceptive multimodal content. However, misinformation often contains semantic information incongruity with the facts. To address these challenges, we propose Incongruity-aware Distribution Optimization (IDO) to improve the performance of fake news detection from the perspectives of factual incongruity and modality incongruity. For factual incongruity, we introduce a channel-wise reweighting strategy to obtain semantically discriminative embeddings and utilize gaussian distribution to model the uncertain correlation caused by factual incongruity. For modality incongruity, we utilize incongruity contrastive learning to learn cross-modal semantic information. Experiments demonstrate that IDO achieves state-of-the-art performance.

假新闻检测多模态不一致建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。