提出可解释的AI图像真伪检测方法,定位并说明伪造证据。
Grounding and Explaining Visual Evidence for AI-Generated Image Detection in Human-Centric Scenes

- 构建联合预测、定位与解释的框架,确保图文一致。
- 在4万张真人图和3.9万张生成图上验证,准确率达92.3%。
- 适合需要可信图像审核的场景,如新闻审查或社交媒体监管。
快速发展的图像生成模型亟需可解释的真伪检测方法,不仅判断图像真实性,还需提供支持性的视觉证据。现有方法常出现解释与定位区域不一致的问题,削弱了决策可靠性。同时,现有基准对多样化的人像场景覆盖有限。为此,本文研究人像场景中具有语义锚定的可解释真伪检测。提出HAVE(Human-centric AI-generated Visual Evidence)数据集,包含来自10个主流生成器的4万张真实图像与3.9万张生成图像,共10.6万例标注的视觉证据实例,涵盖8类证据类型,每条均配有边界框和区域对齐的解释。进一步提出PAVE框架,联合完成真伪预测、视觉证据定位与区域对齐解释生成。PAVE采用判别引导的一致性奖励评估区域-解释一致性与证据有效性,并引入感知正则化,通过对比原始图像与随机掩码图像的词元级预测,强化对视觉输入的依赖。在HAVE及外部数据集上的实验表明,该方法在真伪检测、证据定位与解释质量方面均表现优异。代码与数据将在发表后公开。
原文摘要 · Abstract (English)
Rapid advances in image generation models call for interpretable AI-generated image detection methods that not only determine authenticity but also provide supporting visual evidence. Existing approaches may produce inconsistencies between generated explanations and localized evidence regions, undermining the reliability of explanations for authenticity decisions. Meanwhile, existing benchmarks provide limited coverage of the diverse human-centric scenes prevalent in generated imagery. To address these limitations, we investigate authenticity detection with grounded and explainable visual evidence in human-centric scenes. We present HAVE (Human-centric AI-generated Visual Evidence), a diverse human-centric dataset comprising 40K real and 39K AI-generated images from 10 recent generators, with 106K localized evidence instances across 8 evidence categories, each annotated with a bounding box and a region-aligned explanation. We further propose PAVE, a Perception-Aware Visual Evidence framework that jointly performs authenticity prediction, visual evidence grounding, and region-aligned explanation generation. PAVE employs a judge-guided alignment reward to assess region--explanation consistency and evidence validity, together with perception-aware regularization that contrasts token-level predictions between original and randomly masked images to promote reliance on visual input. Experiments on HAVE and external datasets demonstrate strong performance in authenticity detection, visual evidence grounding, and explanation quality. Code and data will be released upon publication.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。