arXiv:2606.06918cs.CV2026-06被引 1

通过学习真实图像的不变性流形,提升生成图像检测的泛化能力。

DRIFT: From Robustness Gaps to Invariance Manifolds for AI-Generated Image Detection

论文配图:DRIFT: From Robustness Gaps to Invariance Manifolds for AI-Generated Image Detection
图 1 · 摘自论文原文
  • 基于冻结视觉模型构建鲁棒与脆弱子空间,分离物理变换与编辑扰动
  • 在未见生成器上实现95%以上准确率,显著优于现有无训练方法
  • 可生成可解释的异常定位图,适合安全审计与内容溯源场景

生成图像模型的快速演进挑战了现有检测方法,尤其在开放世界中面对未知生成器时。现有无训练方法依赖预训练模型固有的不变性几何结构,难以适应检测任务。本文将生成图像检测建模为在单类监督下学习真实图像的结构化不变性流形。基于冻结的视觉基础模型(VFMs),引入轻量级投影头,将表示空间分解为互补的鲁棒与脆弱子空间:鲁棒子空间显式抑制真实成像变换带来的变化,近似真实图像流形的切向方向;脆弱子空间保留对编辑类扰动的敏感性。结构化排序边距强制物理不变性与编辑变异性的分层分离,使检测转化为相对于学习流形的边距违反测试。推理阶段,多尺度块级漂移同时作用于两类变换,生成双通道不变性签名和可解释定位。大量实验表明,在未见生成器和分辨率下具有强开放世界泛化能力,持续超越无训练鲁棒性基线,并提供可解释的不变性违反图。

原文摘要 · Abstract (English)

The rapid evolution of generative image models challenges existing AI-generated image detectors, particularly in open-world settings with unseen generators. Recent training-free approaches measure robustness gaps in frozen vision foundation models (VFMs), detecting fakes via perturbation-induced embedding drift. However, these methods rely on fixed invariance geometry inherited from pretraining and lack principled adaptation to the detection task. We instead formulate AI-generated image detection as learning a structured invariance manifold of real images under one-class supervision. Building upon a frozen VFM, we introduce lightweight projection heads that decompose representation space into complementary robust and fragile subspaces. The robust subspace is explicitly trained to suppress variations induced by physically plausible imaging transformations, approximating tangent directions of a real-image manifold, while the fragile subspace retains sensitivity to edit-like perturbations. A structured ordering margin enforces hierarchical separation between physical invariance and edit-induced variability, enabling detection as a margin-violation test relative to the learned manifold. At inference, multi-scale patch-wise drift under both transformation families yields a dual-channel invariance signature and interpretable localization. Extensive experiments demonstrate strong open-world generalization across unseen generators and resolutions, consistently outperforming training-free robustness-based baselines while providing interpretable invariance-violation maps.

图像检测生成内容不变性学习可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。