arXiv:2606.00606cs.CV2026-06中稿 · ICML

提升AI图像检测跨域泛化能力,通过细粒度特征表示区分合成图像来源。

FiSeR: Fine-Grained Source Representations for Cross-Domain AI Image Detection

论文配图:FiSeR: Fine-Grained Source Representations for Cross-Domain AI Image Detection
图 1 · 摘自论文原文
  • 构建分层对比学习框架,同时优化自然与合成图像的粗粒度区分和合成图像间的细粒度分类。
  • 在多个跨域测试集上平均提升AUROC达+10.22,少样本适配下最高提升+17.41。
  • 适合需要强跨域鲁棒性的AI图像伪造检测应用场景,尤其适用于生成器多样性高的场景。

真实世界中的合成图像检测器在领域偏移下泛化能力差,尽管其在训练域表现良好。通过无监督UMAP投影发现,自然与合成图像在未见数据集上仍部分可分,但性能仍下降,表明分类头过度拟合训练域伪影。因此,关键在于学习更可迁移的表征,使决策准则对领域变化更稳定。基于合成图像由多种生成器产生这一结构事实,我们提出一种分层对比学习框架,在增强自然与合成图像可分性的同时保留生成器身份信息。该框架联合优化:(i) 自然与合成图像间的粗粒度对比目标;(ii) 合成图像间基于生成器身份的细粒度对比目标。在WildFake上训练后,本方法在与强基线DIRE相同设置下,于Chameleon、AIGIBench、Community Forensics和GenImage上实现平均AUROC提升+10.22。在少样本适配中,冻结主干网络并用每类10个标签样本拟合SVM分类器,于AIGIBench上提升+10.64,于Chameleon上提升+17.41(平均覆盖12种主流检测器)。代码已公开于https://github.com/heyongxin233/FiSeR。

原文摘要 · Abstract (English)

Real-world synthetic image detectors often generalize poorly under domain shift despite strong in-domain performance. Using unsupervised UMAP projections, we find that natural and synthetic features remain partially separable on unseen datasets, yet performance still drops, suggesting that the classification head overfits to training-domain artifacts. Therefore, the key is to learn more transferable representations so that the decision criterion is more stable and robust to domain shifts. Based on the structural fact that synthetic images are produced by diverse generators, we propose a hierarchical contrastive learning framework that improves the separability between natural and synthetic images while preserving generator identity information. It jointly optimizes (i) a coarse contrastive objective between natural and synthetic images and (ii) a fine contrastive objective among synthetic images using generator identities. Trained on WildFake, our method achieves an average AUROC gain of +10.22 on cross-domain evaluation over Chameleon, AIGIBench, Community Forensics, and GenImage under the same settings as the strong baseline DIRE. For few-shot adaptation, we freeze the backbone and fit an SVM head on 10 labeled samples per class, improving AUROC by +10.64 on AIGIBench and +17.41 on Chameleon, averaged over 12 widely used detectors. Our code is publicly available at: https://github.com/heyongxin233/FiSeR.

图像检测跨域泛化对比学习伪造识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。