arXiv:2503.03107cs.CLcs.AI2025-03AAAI被引 21

利用可靠外部信息增强多模态对比学习,提升假新闻检测效果

External Reliable Information-enhanced Multimodal Contrastive Learning for Fake News Detection

  • 通过实体增强的外部信息融合,提升新闻内容表征
  • 采用多模态语义交互与对比学习,实现跨模态信息互补
  • 自适应融合多维特征,适用于跨语言假新闻检测

随着互联网快速发展,信息传播效率显著提升,但也加速了假新闻的扩散,对网络空间造成负面影响。新闻形式已从文本逐步演变为多模态内容,因此多模态假新闻检测成为研究热点。然而,该领域仍面临两大挑战:难以充分有效利用多模态信息,以及引入的外部信息可信度低或静态更新。为此,本文提出ERIC-FND框架,通过实体增强的外部信息增强方法强化新闻内容表征,并利用多模态语义交互与对比学习,使不同模态表示相互学习。此外,采用自适应融合策略整合多维度新闻表征进行最终分类。在跨语言的两个常用数据集X(Twitter)和Weibo上进行实验,结果表明,所提模型在相同设置下优于现有最先进方法。

原文摘要 · Abstract (English)

With the rapid development of the Internet, the information dissemination paradigm has changed and the efficiency has been improved greatly. While this also brings the quick spread of fake news and leads to negative impacts on cyberspace. Currently, the information presentation formats have evolved gradually, with the news formats shifting from texts to multimodal contents. As a result, detecting multimodal fake news has become one of the research hotspots. However, multimodal fake news detection research field still faces two main challenges: the inability to fully and effectively utilize multimodal information for detection, and the low credibility or static nature of the introduced external information, which limits dynamic updates. To bridge the gaps, we propose ERIC-FND, an external reliable information-enhanced multimodal contrastive learning framework for fake news detection. ERIC-FND strengthens the representation of news contents by entity-enriched external information enhancement method. It also enriches the multimodal news information via multimodal semantic interaction method where the multimodal constrative learning is employed to make different modality representations learn from each other. Moreover, an adaptive fusion method is taken to integrate the news representations from different dimensions for the eventual classification. Experiments are done on two commonly used datasets in different languages, X (Twitter) and Weibo. Experiment results demonstrate that our proposed model ERIC-FND outperforms existing state-of-the-art fake news detection methods under the same settings.

假新闻检测多模态学习对比学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。