arXiv:2603.09242cs.CV2026-03被引 2

提出几何语义解耦方法,提升AI生成图像检测的泛化能力。

When Detectors Forget Forensics: Blocking Semantic Shortcuts for Generalizable AI-Generated Image Detection

  • 通过抑制主导语义方向,让模型关注伪造特征而非内容语义。
  • 在未见过的生成管道上,检测准确率提升超15倍,计算开销降低。
  • 适合需要跨模型、跨数据集泛化的图像真实性检测场景。

生成模型的日益逼真使真实与合成内容的界限模糊,给可靠的AI生成图像检测带来挑战。尽管大规模预训练视觉基础模型提升了检测能力,但其对未见生成管道图像的泛化能力仍不足。本文首次揭示关键失败机制——语义回退,即取证微调未能完全重塑表征空间,导致表征仍沿高层语义结构组织,而非特定篡改线索。基于此,我们提出几何语义解耦(GSD)框架,显式抑制语义主导方向,促进不变的取证表征。具体地,GSD利用冻结的CLIP编码器通过奇异值分解(SVD)估计主导语义子空间,并通过几何约束公式抑制语义成分,抑制强度在样本和层间自适应调节。此外,引入小批量SVD近似策略,摊销子空间估计成本,实现计算开销降低超过15倍的同时保持有效性。最后,针对大规模与在线评估等实际场景,设计批处理、逐样本与参考基推理三种协议,证明其均能诱导一致的语义解耦,生成稳定的伪造导向特征流形。

原文摘要 · Abstract (English)

The growing realism of generative models has blurred the boundary between real and synthetic content, posing significant challenges to reliable AI-generated image detection. Although large-scale pre-trained Vision Foundation Models have advanced detection capability, their generalization to images from unseen generation pipelines remains inadequate. In this paper, we identify, for the first time, a key failure mechanism, termed \emph{semantic fallback}, wherein forensic fine-tuning fails to fully reshape the representation space. Consequently, the resulting representations remain organized along high-level semantic structures rather than manipulation-specific forensic cues. Building on this insight, we propose a \textbf{Geometric Semantic Decoupling (GSD)} framework, which explicitly suppresses semantically dominant directions, thereby promoting invariant forensic representations. Specifically, GSD leverages a frozen CLIP encoder to estimate the dominant semantic subspace via Singular Value Decomposition (SVD). It then suppresses the semantic components through a geometry-constrained formulation with the suppression strength adaptively modulated across samples and layers. We further introduce a mini-batch SVD approximation strategy that amortizes subspace estimation, achieving over a $15 \times$ reduction in computational overhead while preserving effectiveness. Finally, considering practical scenarios spanning both large-scale and online evaluation, we develop three inference protocols, batch, per-sample, and reference-based inference, and demonstrate that they induce consistent semantic decoupling, yielding a stable forgery-oriented feature manifold.

图像检测语义解耦泛化能力CLIP

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。