用统一模型检测各种伪造图像,速度比现有方法快22倍以上
R$^2$BD: A Reconstruction-Based Method for Generalizable and Efficient Detection of Fake Images
- 设计通用重建模型G-LDM,兼容VAE/GAN/扩散模型生成特征
- 单次推理计算残差偏差,检测速度提升22倍以上
- 跨数据集表现优异,适合需要高效泛化检测的场景
近年来,基于重建的方法因其对数据集特定伪影依赖少、在分布偏移下具备更好泛化能力而受到关注。这类方法利用预训练扩散模型重建输入并测量残差以区分真实与伪造图像。然而,其多步反演和重建过程导致效率低下,且依赖扩散模型主干也限制了对GAN等其他生成范式的效果。本文提出新型伪造图像检测框架R$^2$BD,包含两项关键设计:(1) G-LDM,一种统一重建模型,可模拟VAE、GAN和扩散模型的生成行为,从而扩展检测范围;(2) 残差偏差计算模块,在单次推理中完成真假判断,显著优于传统需20+步的方法。在10个公开数据集上的实验表明,R$^2$BD比现有重建方法快22倍以上,且跨数据集平均性能领先当前最优方法13.87%。代码与数据集见https://github.com/QingyuLiu/RRBD。
原文摘要 · Abstract (English)
Recently, reconstruction-based methods have gained attention for AIGC image detection. These methods leverage pre-trained diffusion models to reconstruct inputs and measure residuals for distinguishing real from fake images. Their key advantage lies in reducing reliance on dataset-specific artifacts and improving generalization under distribution shifts. However, they are limited by significant inefficiency due to multi-step inversion and reconstruction, and their reliance on diffusion backbones further limits generalization to other generative paradigms such as GANs. In this paper, we propose a novel fake image detection framework, called R$^2$BD, built upon two key designs: (1) G-LDM, a unified reconstruction model that simulates the generation behaviors of VAEs, GANs, and diffusion models, thereby broadening the detection scope beyond prior diffusion-only approaches; and (2) a residual bias calculation module that distinguishes real and fake images in a single inference step, which is a significant efficiency improvement over existing methods that typically require 20$+$ steps. Extensive experiments on the benchmark from 10 public datasets demonstrate that R$^2$BD is over 22$\times$ faster than existing reconstruction-based methods while achieving superior detection accuracy. In cross-dataset evaluations, it outperforms state-of-the-art methods by an average of 13.87\%, showing strong efficiency and generalization across diverse generative methods. The code and dataset used for evaluation are available at https://github.com/QingyuLiu/RRBD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。