提出新方法检测不同生成模型的假图,跨架构泛化能力强。
Beyond Binary Classification: A Semi-supervised Approach to Generalized AI-generated Image Detection
- 基于生成架构差异设计半监督检测模型,挖掘假图中的潜在模式。
- 在13个基线对比中表现更优,跨架构检测准确率显著提升。
- 适合需要泛化检测未知生成工具图像的研究者和安全团队。
生成模型(如StyleGAN、Midjourney、DALL-E)的快速发展产生了高度逼真的合成图像,严重威胁数字媒体真实性。这些模型主要基于生成对抗网络(GANs)和扩散模型(DMs)两类架构。当前检测方法的一大弱点是难以实现跨生成器泛化,尤其在跨越架构边界(如从GAN到DM)时表现不佳。我们假设这一差距源于两类架构产生的伪造痕迹存在本质差异。本文从理论上分析了GAN与DM因优化目标不同导致的流形覆盖行为差异:GAN存在部分覆盖,常产生边界伪影;而DM强制完全覆盖,导致过平滑现象。基于此,我们提出半监督检测方法TriDetect,通过平衡聚类分配(采用Sinkhorn-Knopp算法)与跨视图一致性机制,增强模型对生成架构特征的学习能力。在两个标准基准和三个真实场景数据集上评估,对比13个基线,验证了其对未见生成器的强大泛化能力。
原文摘要 · Abstract (English)
The rapid advancement of generators (e.g., StyleGAN, Midjourney, DALL-E) has produced highly realistic synthetic images, posing significant challenges to digital media authenticity. These generators are typically based on a few core architectural families, primarily Generative Adversarial Networks (GANs) and Diffusion Models (DMs). A critical vulnerability in current forensics is the failure of detectors to achieve cross-generator generalization, especially when crossing architectural boundaries (e.g., from GANs to DMs). We hypothesize that this gap stems from fundamental differences in the artifacts produced by these \textbf{distinct architectures}. In this work, we provide a theoretical analysis explaining how the distinct optimization objectives of the GAN and DM architectures lead to different manifold coverage behaviors. We demonstrate that GANs permit partial coverage, often leading to boundary artifacts, while DMs enforce complete coverage, resulting in over-smoothing patterns. Motivated by this analysis, we propose the \textbf{Tri}archy \textbf{Detect}or (TriDetect), a semi-supervised approach that enhances binary classification by discovering latent architectural patterns within the "fake" class. TriDetect employs balanced cluster assignment via the Sinkhorn-Knopp algorithm and a cross-view consistency mechanism, encouraging the model to learn fundamental architectural distincts. We evaluate our approach on two standard benchmarks and three in-the-wild datasets against 13 baselines to demonstrate its generalization capability to unseen generators.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。