arXiv:2511.22351cs.CV2025-11

让AI生成图的伪造痕迹可解释,连16x16图像也能看懂。

INSIGHT: An Interpretable Neural Vision-Language Framework for Reasoning of Generative Artifacts

  • 用分层超分放大细微伪造特征,不引入新假象
  • 通过梯度定位和语义对齐,精准找出生成痕迹区域
  • 生成人类能看懂的详细解释,适合高风险场景使用

近期生成对抗网络与扩散模型生成的图像愈发逼真,引发对视觉媒体可信度的担忧。然而,现有取证系统在真实场景下(如严重下采样、压缩、跨域分布偏移)性能急剧下降,且多数检测器为黑箱,无法说明为何判定为合成图像,削弱了可信度。本文提出INSIGHT(可解释的神经视觉-语言生成物推理框架),统一实现鲁棒检测与透明解释,即使在极端低分辨率(16x16–64x64)下仍有效。该框架结合分层超分辨率增强微弱取证线索,避免误导性伪影;利用基于梯度的多尺度定位识别生成模式区域;通过CLIP引导的语义对齐将视觉异常映射为人类可理解描述。再以结构化ReAct+思维链提示词驱动视觉-语言模型生成一致、细粒度解释,并通过双阶段G-Eval + LLM评判管道验证事实性,减少幻觉。在动物、车辆、抽象合成场景等多样领域中,INSIGHT显著提升检测鲁棒性与解释质量,优于先前检测器与黑箱视觉语言模型基线。结果表明,该方法为可信赖的多模态内容验证提供可行路径。

原文摘要 · Abstract (English)

The growing realism of AI-generated images produced by recent GAN and diffusion models has intensified concerns over the reliability of visual media. Yet, despite notable progress in deepfake detection, current forensic systems degrade sharply under real-world conditions such as severe downsampling, compression, and cross-domain distribution shifts. Moreover, most detectors operate as opaque classifiers, offering little insight into why an image is flagged as synthetic, undermining trust and hindering adoption in high-stakes settings. We introduce INSIGHT (Interpretable Neural Semantic and Image-based Generative-forensic Hallucination Tracing), a unified multimodal framework for robust detection and transparent explanation of AI-generated images, even at extremely low resolutions (16x16 - 64x64). INSIGHT combines hierarchical super-resolution for amplifying subtle forensic cues without inducing misleading artifacts, Grad-CAM driven multi-scale localization to reveal spatial regions indicative of generative patterns, and CLIP-guided semantic alignment to map visual anomalies to human-interpretable descriptors. A vision-language model is then prompted using a structured ReAct + Chain-of-Thought protocol to produce consistent, fine-grained explanations, verified through a dual-stage G-Eval + LLM-as-a-judge pipeline to minimize hallucinations and ensure factuality. Across diverse domains, including animals, vehicles, and abstract synthetic scenes, INSIGHT substantially improves both detection robustness and explanation quality under extreme degradation, outperforming prior detectors and black-box VLM baselines. Our results highlight a practical path toward transparent, reliable AI-generated image forensics and establish INSIGHT as a step forward in trustworthy multimodal content verification.

AI伪造检测可解释性视觉语言模型多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。