通过分析生成图像的隐式流形偏差,实现零样本与少样本检测。
Manifold Induced Biases for Zero-shot and Few-shot Detection of Generated Images
- 利用预训练扩散模型的得分函数分析流形曲率与梯度偏差。
- 在20个生成模型上实现零样本与少样本检测性能超越现有方法。
- 为生成内容检测提供理论支撑,适合对抗新型生成技术的研究者。
区分真实图像与AI生成图像(即图像检测)是一个紧迫且重要的挑战。尽管半监督/监督方法研究广泛,但零样本与少样本方案近年来成为有前景的替代方案,其优势在于缓解因生成技术迭代导致的数据维护过时问题。本文指出两大缺口:(1) 方法缺乏理论基础;(2) 零样本与少样本下的性能仍有提升空间。我们的方法基于对生成内容固有偏差的理解与量化,将这些量作为判别依据。具体地,我们研究由预训练扩散模型捕捉的隐式概率流形偏差,通过得分函数分析近似曲率、梯度及对流形点的偏倚,建立零样本检测标准。进一步地,通过混合专家方法拓展至少样本场景。在20个生成模型上的实证结果表明,本方法在零样本与少样本设置中均优于当前主流方法。该工作从流形分析视角推进了对生成内容偏差的理论理解与实际应用。
原文摘要 · Abstract (English)
Distinguishing between real and AI-generated images, commonly referred to as 'image detection', presents a timely and significant challenge. Despite extensive research in the (semi-)supervised regime, zero-shot and few-shot solutions have only recently emerged as promising alternatives. Their main advantage is in alleviating the ongoing data maintenance, which quickly becomes outdated due to advances in generative technologies. We identify two main gaps: (1) a lack of theoretical grounding for the methods, and (2) significant room for performance improvements in zero-shot and few-shot regimes. Our approach is founded on understanding and quantifying the biases inherent in generated content, where we use these quantities as criteria for characterizing generated images. Specifically, we explore the biases of the implicit probability manifold, captured by a pre-trained diffusion model. Through score-function analysis, we approximate the curvature, gradient, and bias towards points on the probability manifold, establishing criteria for detection in the zero-shot regime. We further extend our contribution to the few-shot setting by employing a mixture-of-experts methodology. Empirical results across 20 generative models demonstrate that our method outperforms current approaches in both zero-shot and few-shot settings. This work advances the theoretical understanding and practical usage of generated content biases through the lens of manifold analysis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。