通过像素与频域双重对齐,提升AI生成图像检测器的泛化能力。
Dual Data Alignment Makes AI-Generated Image Detector Easier Generalizable
- 提出双域对齐方法,同时匹配图像像素与频率特征。
- 在8个基准上提升检测性能,野外数据集提升7.2%。
- 构建新测试集DDA-COCO和EvalGEN,评估新型生成模型。
现有检测器常在有偏数据集上训练,导致对非因果特征(如与真实/合成标签虚假相关的属性)过拟合。尽管这些特征在训练集上表现良好,但在无偏数据集上性能显著下降。当前常见解决方案是通过生成重建实现数据集对齐,使真实与合成图像语义一致。但本文重新审视该方法,发现仅像素级对齐不足:重建图像仍存在频域错位,可能加剧虚假关联。我们观察到,重建模型倾向于恢复真实图像中因JPEG压缩丢失的高频细节,导致合成图像在高频内容上看似更丰富,进而使检测器将高频特征与合成标签绑定,强化偏差。为此,我们提出双数据对齐(DDA),同步对齐像素与频率域。此外,构建两个新测试集:DDA-COCO用于测试在高度对齐数据上的检测性能,EvalGEN则包含最新生成模型(如视觉自回归生成器),以评估检测器在新型生成架构下的表现。大量实验表明,仅在DDA对齐的MSCOCO数据集上训练的检测器,在8个不同基准上均取得显著提升,尤其在野外数据集上提升7.2%,证明无偏检测器具备更强泛化能力。代码已开源。
原文摘要 · Abstract (English)
Existing detectors are often trained on biased datasets, leading to the possibility of overfitting on non-causal image attributes that are spuriously correlated with real/synthetic labels. While these biased features enhance performance on the training data, they result in substantial performance degradation when applied to unbiased datasets. One common solution is to perform dataset alignment through generative reconstruction, matching the semantic content between real and synthetic images. However, we revisit this approach and show that pixel-level alignment alone is insufficient. The reconstructed images still suffer from frequency-level misalignment, which can perpetuate spurious correlations. To illustrate, we observe that reconstruction models tend to restore the high-frequency details lost in real images (possibly due to JPEG compression), inadvertently creating a frequency-level misalignment, where synthetic images appear to have richer high-frequency content than real ones. This misalignment leads to models associating high-frequency features with synthetic labels, further reinforcing biased cues. To resolve this, we propose Dual Data Alignment (DDA), which aligns both the pixel and frequency domains. Moreover, we introduce two new test sets: DDA-COCO, containing DDA-aligned synthetic images for testing detector performance on the most aligned dataset, and EvalGEN, featuring the latest generative models for assessing detectors under new generative architectures such as visual auto-regressive generators. Finally, our extensive evaluations demonstrate that a detector trained exclusively on DDA-aligned MSCOCO could improve across 8 diverse benchmarks by a non-trivial margin, showing a +7.2% on in-the-wild benchmarks, highlighting the improved generalizability of unbiased detectors. Our code is available at: https://github.com/roy-ch/Dual-Data-Alignment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。