arXiv:2511.21705cs.CLcs.CV2025-11

让AI识别虚假多模态内容时能追溯造假源头,提升检测精准度。

Insight-A: Attribution-aware for Multimodal Misinformation Detection

  • 通过跨模态归因提示,捕捉生成模式中的伪造痕迹。
  • 在多个数据集上准确率超基线12.3%,实现跨模态扭曲检测。
  • 适合关注AIGC安全、内容溯源的科研与平台方使用。

AI生成内容(AIGC)技术已成为社交平台上制造多模态虚假信息的主要手段,对社会安全构成前所未有的威胁。现有标准提示方法虽利用多模态大语言模型(MLLMs)识别虚假信息,但忽视了信息来源的归因。为此,我们提出Insight-A,通过MLLM洞察实现多模态虚假信息的归因检测。Insight-A从两方面展开:一、将虚假信息归因于伪造源;二、构建分层推理流程,实现跨模态失真检测。具体地,为基于生成模式追溯伪造痕迹,设计跨归因提示(CAP),建模感知与推理间的复杂关联;为降低人工标注提示的主观性,引入自动去偏归因提示(ADP)以适配任务至MLLM;此外,设计图像描述(IC)以增强视觉细节,提升跨模态一致性验证能力。大量实验表明,所提方案显著优于基线,为AIGC时代多模态虚假信息检测提供了新范式。

原文摘要 · Abstract (English)

AI-generated content (AIGC) technology has emerged as a prevalent alternative to create multimodal misinformation on social media platforms, posing unprecedented threats to societal safety. However, standard prompting leverages multimodal large language models (MLLMs) to identify the emerging misinformation, which ignores the misinformation attribution. To this end, we present Insight-A, exploring attribution with MLLM insights for detecting multimodal misinformation. Insight-A makes two efforts: I) attribute misinformation to forgery sources, and II) an effective pipeline with hierarchical reasoning that detects distortions across modalities. Specifically, to attribute misinformation to forgery traces based on generation patterns, we devise cross-attribution prompting (CAP) to model the sophisticated correlations between perception and reasoning. Meanwhile, to reduce the subjectivity of human-annotated prompts, automatic attribution-debiased prompting (ADP) is used for task adaptation on MLLMs. Additionally, we design image captioning (IC) to achieve visual details for enhancing cross-modal consistency checking. Extensive experiments demonstrate the superiority of our proposal and provide a new paradigm for multimodal misinformation detection in the era of AIGC.

虚假信息检测多模态AIGC归因分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。