通过自然图像与生成图像的几何差异,实现高效无监督检测。
Detecting Generated Images by Fitting Natural Image Distributions
- 利用自然与生成图像在数据流形上的几何差异设计检测机制。
- 在多种生成模型下检测准确率超90%,对高级生成模型仍有效。
- 无需标注数据,适合缺乏生成样本的检测场景。
生成图像日益逼真,引发滥用担忧,亟需可靠的检测方法。现有方法多依赖大量已知生成图像训练二分类器,效果受限于数据规模与质量。本文提出新框架,利用自然图像与生成图像在数据流形上的几何差异:设计一对函数,使自然图像输出一致而生成图像输出发散,基于其梯度位于正交子空间的特性。该方法仅需一个在自然图像上预训练的自监督模型,通过沿图像流形施加变换,若损失值显著变化则判定为生成图像。为进一步应对先进生成模型导致的流形差异减弱问题,引入归一化流(normalizing flows)将生成图像从自然流形中拉离,增强可检测性。大量实验验证了该方法的有效性,在多个生成模型上检测准确率均超过90%。代码已公开于 https://github.com/tmlr-group/ConV。
原文摘要 · Abstract (English)
The increasing realism of generated images has raised significant concerns about their potential misuse, necessitating robust detection methods. Current approaches mainly rely on training binary classifiers, which depend heavily on the quantity and quality of available generated images. In this work, we propose a novel framework that exploits geometric differences between the data manifolds of natural and generated images. To exploit this difference, we employ a pair of functions engineered to yield consistent outputs for natural images but divergent outputs for generated ones, leveraging the property that their gradients reside in mutually orthogonal subspaces. This design enables a simple yet effective detection method: an image is identified as generated if a transformation along its data manifold induces a significant change in the loss value of a self-supervised model pre-trained on natural images. Further more, to address diminishing manifold disparities in advanced generative models, we leverage normalizing flows to amplify detectable differences by extruding generated images away from the natural image manifold. Extensive experiments demonstrate the efficacy of this method. Code is available at https://github.com/tmlr-group/ConV.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。