arXiv:2412.17671cs.CV2024-12CVPR被引 81

用真实图生成假图,避免数据偏见,提升检测器泛化能力

A Bias-Free Training Paradigm for More General AI-generated Image Detection

  • 用Stable Diffusion条件生成假图,确保内容一致仅差异在生成痕迹
  • 在27种生成模型上检测准确率显著优于现有方法,尤其对FLUX和SD3.5有效
  • 适合需要高鲁棒性、低偏见的AI图像检测场景

成功的伪造检测器在监督学习基准上表现优异,但在真实场景中难以迁移。我们认为主要原因是训练数据质量不足。现有研究多聚焦算法创新,却忽视了数据选择的影响——如内容、格式或分辨率带来的虚假关联会严重干扰检测效果。理想的检测器应识别生成特定痕迹,而非依赖数据偏见。为此,我们提出B-Free:一种无偏训练范式,通过稳定扩散模型的条件过程,从真实图像生成假图像,保证语义一致性,使所有差异仅源于AI生成引入的细微痕迹。结合基于内容的增强策略,B-Free在27种生成模型(包括FLUX和Stable Diffusion 3.5)上均实现更强的泛化性与鲁棒性,且结果更校准。研究强调了数据设计的重要性,呼吁进一步探索该方向。代码与数据公开于https://grip-unina.github.io/B-Free/

原文摘要 · Abstract (English)

Successful forensic detectors can produce excellent results in supervised learning benchmarks but struggle to transfer to real-world applications. We believe this limitation is largely due to inadequate training data quality. While most research focuses on developing new algorithms, less attention is given to training data selection, despite evidence that performance can be strongly impacted by spurious correlations such as content, format, or resolution. A well-designed forensic detector should detect generator specific artifacts rather than reflect data biases. To this end, we propose B-Free, a bias-free training paradigm, where fake images are generated from real ones using the conditioning procedure of stable diffusion models. This ensures semantic alignment between real and fake images, allowing any differences to stem solely from the subtle artifacts introduced by AI generation. Through content-based augmentation, we show significant improvements in both generalization and robustness over state-of-the-art detectors and more calibrated results across 27 different generative models, including recent releases, like FLUX and Stable Diffusion 3.5. Our findings emphasize the importance of a careful dataset design, highlighting the need for further research on this topic. Code and data are publicly available at https://grip-unina.github.io/B-Free/.

图像检测生成模型数据偏见扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。