arXiv:2411.11016cs.CVcs.AI2024-11被引 1

不依赖生成模型即可检测扩散模型生成的伪造图像。

Time Step Generating: A Universal Synthesized Deepfake Image Detector

  • 通过控制网络输入的时间步提取细微差异特征
  • 在GenImage基准上准确率与泛化性显著提升
  • 无需重建过程,适合多种生成模型和数据集

当前高质量文生图模型发展迅速,其中扩散模型极大提升了图像生成质量,使真实与合成图像难以区分,引发隐私与安全担忧。现有方法依赖于重建过程,但该过程耗时且对预训练生成模型高度敏感,一旦模型域外即性能下降。为此,我们提出通用合成图像检测器Time Step Generating(TSG),不依赖预训练模型的重建能力、特定数据集或采样算法。方法利用预训练扩散模型作为特征提取器,捕捉真实与合成图像间的细微差异,通过控制网络输入的时间步t有效提取区分性特征,再经分类器(如ResNet)判断图像真伪。在大规模GenImage基准测试中,TSG在准确率与泛化性上均取得显著提升。

原文摘要 · Abstract (English)

Currently, high-fidelity text-to-image models are developed in an accelerating pace. Among them, Diffusion Models have led to a remarkable improvement in the quality of image generation, making it vary challenging to distinguish between real and synthesized images. It simultaneously raises serious concerns regarding privacy and security. Some methods are proposed to distinguish the diffusion model generated images through reconstructing. However, the inversion and denoising processes are time-consuming and heavily reliant on the pre-trained generative model. Consequently, if the pre-trained generative model meet the problem of out-of-domain, the detection performance declines. To address this issue, we propose a universal synthetic image detector Time Step Generating (TSG), which does not rely on pre-trained models' reconstructing ability, specific datasets, or sampling algorithms. Our method utilizes a pre-trained diffusion model's network as a feature extractor to capture fine-grained details, focusing on the subtle differences between real and synthetic images. By controlling the time step t of the network input, we can effectively extract these distinguishing detail features. Then, those features can be passed through a classifier (i.e. Resnet), which efficiently detects whether an image is synthetic or real. We test the proposed TSG on the large-scale GenImage benchmark and it achieves significant improvements in both accuracy and generalizability.

图像检测扩散模型伪造识别通用检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。