arXiv:2504.01396cs.CV2025-04被引 25

通过全图块学习提升AI生成图像检测能力,让每个图块都发挥作用。

All Patches Matter, More Patches Better: Enhance AI-Generated Image Detection via Panoptic Patch Learning

  • 提出全图块学习框架,强制模型关注所有图块的伪造特征。
  • 在多个数据集上检测准确率提升显著,尤其在跨域场景中表现更优。
  • 适合需要高鲁棒性检测的AI内容安全、媒体真实性验证场景。

AI生成图像(AIGIs)的爆炸式增长凸显了构建鲁棒且泛化能力强的检测方法的紧迫性。本文通过系统分析确立两个关键原则:(1)所有图块都重要——与传统图像分类中判别特征集中于物体区域不同,AIGI中每个图块因统一生成过程而天然包含合成伪影,表明每个图块都是重要的伪造信息来源;(2)更多图块更好——利用更多图块中的分布式伪影可捕获互补的取证证据,减少对特定图块的依赖,从而提升鲁棒性和泛化能力。然而,反事实分析发现:未经优化的检测器常表现出少数图块偏倚,仅依赖少数明显图块进行判断。我们识别出根本原因在于‘懒惰学习者’:检测器倾向于学习有限图块中显著的伪影,忽略整体伪影分布。为此,我们提出全景图块学习(PPL)框架,包括:(1)随机图块替换——随机用真实图块替换合成图块,迫使模型识别未被充分利用区域的伪影,促进更多图块的使用;(2)图块级对比学习——强制所有图块具备一致的判别能力,确保各图块被均匀利用。在多个基准数据集上的两类设置下,大量实验验证了该方法的有效性。

原文摘要 · Abstract (English)

The exponential growth of AI-generated images (AIGIs) underscores the urgent need for robust and generalizable detection methods. In this paper, we establish two key principles for AIGI detection through systematic analysis: (1) All Patches Matter: Unlike conventional image classification where discriminative features concentrate on object-centric regions, each patch in AIGIs inherently contains synthetic artifacts due to the uniform generation process, suggesting that every patch serves as an important artifact source for detection. (2) More Patches Better: Leveraging distributed artifacts across more patches improves detection robustness by capturing complementary forensic evidence and reducing over-reliance on specific patches, thereby enhancing robustness and generalization. However, our counterfactual analysis reveals an undesirable phenomenon: naively trained detectors often exhibit a Few-Patch Bias, discriminating between real and synthetic images based on minority patches. We identify Lazy Learner as the root cause: detectors preferentially learn conspicuous artifacts in limited patches while neglecting broader artifact distributions. To address this bias, we propose the Panoptic Patch Learning (PPL) framework, involving: (1) Random Patch Replacement that randomly substitutes synthetic patches with real counterparts to compel models to identify artifacts in underutilized regions, encouraging the broader use of more patches; (2) Patch-wise Contrastive Learning that enforces consistent discriminative capability across all patches, ensuring uniform utilization of all patches. Extensive experiments across two different settings on several benchmarks verify the effectiveness of our approach.

图像检测AI伪造图块学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。