用锚点正则化提升AI图像检测的泛化能力,兼顾真实与生成图像特征。
Anchor-Regularized Adaptation for Generalizable AI-Generated Image Detection with DINOv3

- 引入锚点正则化适配,保留预训练结构同时捕捉像素级伪造特征。
- 在九个基准上达到最优性能,显著提升对未见生成模型的泛化能力。
- 适合需要高泛化性的AI生成内容检测场景,如社交媒体审核。
近期研究发现,精心对齐训练数据可消除虚假相关性,提升AI生成图像检测的泛化能力。然而,即使在非对齐数据上训练,冻结的DINOv3线性探针仍表现出色。我们分析发现,其优异表现源于对真实图像空间特征的忠实建模;但最终层对细微像素伪造痕迹的捕捉能力较弱。直接混合对齐与非对齐数据虽增强对伪造痕迹的敏感度,却会扭曲预训练表示,限制泛化。为此,我们提出锚点正则化适配(ARA):通过低秩适配捕获像素级伪造特征,同时利用冻结锚点分类器防止原始表示偏离。该方法在九个多样且具有挑战性的基准上实现最先进性能,表明ARA能有效融合对齐与非对齐数据的互补监督,实现更优检测效果。
原文摘要 · Abstract (English)
Recent works in AI-generated image detection have shown that careful training data alignment can improve generalization by removing spurious correlations. However, linear probes on frozen DINOv3 representations achieve remarkably strong performance even when trained on misaligned datasets. Motivated by this result, we analyze the underlying rationale and the limits of this generalization. We find that frozen DINOv3 performs well because its decisions rely on features that faithfully represent the space of authentic images. At the same time, its final layer is less effective at capturing the subtle pixel-artifact cues that can be emphasized by aligned training data. We further observe that naively mixing aligned and misaligned data during adaptation improves sensitivity to such cues but at the cost of distorting the pre-trained representation, limiting generalization. To address this issue, we propose Anchor-Regularized Adaptation (ARA). We apply Low-Rank Adaptation to capture pixel-level artifacts while leveraging a frozen anchor classifier to avoid deviations from the original representation structure. This allows the model to exploit pixel-artifact cues without sacrificing generalization. Our method achieves state-of-the-art performance on nine diverse and challenging benchmarks, indicating that ARA enables complementary supervision from misaligned and aligned data for more effective detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。