arXiv:2608.04935cs.CV2026-08

用语言对齐特征提升生成图像检测,性能超越现有最佳方法。

Unleashing the Potential of Vision-Language Models for Generalizable AI-Generated Image Detection

论文配图:Unleashing the Potential of Vision-Language Models for Generalizable AI-Generated Image Detection
图 1 · 摘自论文原文
  • 基于语义原型校准,利用语言模型的高层语义信息构建检测原型。
  • 在跨生成器、后处理和真实场景测试中,准确率比DINOv3高出4.1%。
  • 适合需要强泛化能力的AI图像检测任务,尤其适用于复杂真实场景。

近期研究表明,对现代视觉基础模型(VFMs)冻结表示进行简单线性探测即可实现顶尖的AI生成图像(AIGI)检测性能,在真实场景下显著优于专用检测器。这一发现使DINOv3成为后续改进的主流基线。然而我们发现,视觉-语言模型中的感知编码器(PE)具有更大潜力,因其语言对齐表示保留了高层次的来源语义。具体而言,PE在冻结特征空间中展现出更强的局部来源组织结构。但传统的语义无关线性探测无法利用该结构,导致PE-Linear在In-the-Wild测试上仍比DINOv3-Linear低4.1%。基于此,我们提出语义原型校准(SPC),从取证语义信息构建类别原型,并用监督数据进行校准。将SPC应用于PE,得到的检测器称为PE-SPC。分析表明,该设计具有更强泛化能力。在跨生成器、后处理及真实场景基准测试中,PE-SPC均超越此前的DINOv3基线,达到新最优结果。

原文摘要 · Abstract (English)

Recent work has shown that a simple linear probe on frozen representations from modern vision foundation models (VFMs) can achieve state-of-the-art AIGI detection performance, substantially outperforming specialized detectors in challenging in-the-wild scenarios. This finding has established DINOv3 as the dominant foundation-model baseline for subsequent improvements. However, we find that the vision-language model Perception Encoder (PE) holds greater potential for AIGI detection, because its language-aligned representation preserves high-level provenance semantics. Specifically, PE exhibits stronger local provenance organization than DINOv3 in its frozen feature space. However, semantic-agnostic linear probing fails to exploit this structure, as PE-Linear still underperforms DINOv3-Linear by 4.1% on In-the-Wild. Based on this observation, we propose Semantic Prototype Calibration (SPC), which constructs category prototypes from forensic semantic information and calibrates them with supervised data. We apply SPC to PE and refer to the resulting detector as PE-SPC. Our analysis shows that this simple design achieves stronger generalization. Across cross-generator, post-processing, and in-the-wild benchmarks, PE-SPC surpasses the previous DINOv3 baseline and achieves new state-of-the-art results.

图像检测视觉语言模型生成内容识别泛化能力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。