用对抗修复生成更多样伪造痕迹,提升AI图像检测泛化能力
Reduce the Artifacts Bias for More Generalizable AI-Generated Image Detection

- 用SRGAN生成互补伪造痕迹,与VAE重建形成双源伪造数据
- 在13个基准上检测准确率显著提升,尤其在跨域场景表现更优
- 适合需要高泛化能力的AI图像检测场景,如内容审核与溯源
随着AI生成图像滥用问题加剧,亟需具备泛化能力的检测方法。现有最先进方法通过对齐训练数据来减少内容、尺寸和格式偏差,从而捕捉稳健的伪造线索。常见策略使用重建技术(如VAE和DDIM)构建对齐的合成负样本,但单一重建过程导致伪造痕迹分布狭窄且同质,其他机制产生的痕迹被忽略。为扩大痕迹覆盖范围而不牺牲对齐性,我们采用基于SRGAN的对抗修复生成负样本,其学习的上采样与纹理恢复能产生与VAE互补的伪造痕迹,同时保持内容、尺寸和格式一致。直接混合两种对齐伪造域存在困难,因它们的痕迹流形与优化方向可能冲突。为此,我们提出分两阶段的Artifact-Complementary Expert Fusion(ACEF)框架:首先在冻结的基础骨干网络上通过LoRA适配构建两个特定于伪造痕迹的专家;随后冻结专家,引入分层痕迹互补融合(LACF),通过自适应门控整合多层源特定与跨痕迹证据。在13个多样基准上的大量实验验证了该方法的有效性。
原文摘要 · Abstract (English)
As the misuse of AI-generated images grows, generalizable image detection techniques are urgently needed. Recent state-of-the-art (SOTA) methods adopt aligned training datasets to reduce content, size, and format biases, empowering models to capture robust forgery cues. A common strategy employs reconstruction techniques, e.g., VAE and DDIM, to construct aligned synthetic negatives. However, relying on a single reconstruction process yields a narrow and homogeneous artifact distribution, leaving forensic traces from other artifact-forming mechanisms underrepresented. To broaden artifact coverage without sacrificing alignment, we construct adversarial restoration-based negatives with SRGAN, whose learned upsampling and texture restoration yield traces complementary to VAE reconstruction while preserving content, size, and format. Directly mixing the two aligned fake domains is nontrivial because their artifact manifolds and optimization directions can conflict. We therefore propose Artifact-Complementary Expert Fusion (ACEF), a two-stage framework for robust AIGC detection. ACEF first constructs two artifact-specific experts via LoRA adaptation on a frozen foundation backbone. It then freezes them and introduces Layer-wise Artifact-Complementary Fusion (LACF) to integrate multi-layer source-specific and cross-artifact evidence through an adaptive gate. Extensive experiments on 13 diverse benchmarks demonstrate the effectiveness of our method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。