arXiv:2607.12052cs.CVcs.AI2026-07

不训练模型也能识别AI生成图像来源,关键在选对比较方式和参考图。

Representation and Reference Selection in Training-Free Synthetic Image Attribution

论文配图:Representation and Reference Selection in Training-Free Synthetic Image Attribution
图 1 · 摘自论文原文
  • 用CLIP和DINOv2的中间层特征做图像对比,效果最佳。
  • 中间层特征比高层抽象特征更利于区分不同生成器,准确率最高达89.3%。
  • 语义匹配的参考图能减少误差,适合资源有限时使用。

合成图像归属旨在识别特定AI生成图像的来源生成器。无需训练的基于参考的归属方法易于扩展,因为新出现的生成器只需添加源特定参考图,无需重新训练任务专用分类器。其性能取决于两个相互关联的因素:用于比较的表示空间以及源特定参考图的构建方式。然而,这两个因素之间的交互作用尚未得到充分探索。本文通过使用参考图和现成的预训练表示,对这一交互作用进行了受控分析。我们研究了从CLIP和DINOv2不同层提取的表示,以及三种具有不同语义约束的参考选择方法:任意、语义对齐和基于重合成的参考图。结果表明,归属准确率在中间表示层始终达到峰值,说明源区分性线索在强语义抽象主导前更具可访问性。我们进一步发现,中间表示并非完全语义中立,因此参考选择至关重要:语义受限的参考图能减少查询-参考不匹配,提升归属性能,尤其是在参考预算有限的情况下。重合成方法在低参考数量时最有效,而语义对齐参考图在拥有中等规模参考池时提供更好的准确率-成本权衡。我们的发现表明,无训练参考式归属应理解为图像比较位置、参考集构建方式与可用参考数量之间的相互作用。

原文摘要 · Abstract (English)

Synthetic image attribution aims at identifying the generator responsible for a given AI-generated image. Training-free reference-based attribution methods are easily scalable, since newly emerging generators can be incorporated by adding source-specific references rather than retraining a task-specific classifier. Their performance depends on two coupled factors: the representation space used for comparison and the way source-specific references are constructed. However, the interaction between these two factors remains largely unexplored. In this paper, we provide a controlled analysis of this interaction using references and off-the-shelf pretrained representations. We study representations extracted from different layers of CLIP and DINOv2, along with three reference selection methods with varying semantic constraints: arbitrary, semantically aligned, and resynthesis-based references. Our results show that attribution accuracy consistently peaks at intermediate representation levels, indicating that source-discriminative cues are more accessible before strong semantic abstraction dominates. We further show that intermediate representations are not completely semantically neutral, making reference selection critical: semantically constrained references reduce query-reference mismatch and improve attribution, especially under limited reference budgets. Resynthesis is most useful in low-reference regimes, while semantically aligned references provide a better accuracy-cost trade-off when a moderate-sized reference pool is available. Our findings show that training-free reference-based attribution should be understood as the interaction between where images are compared, how the reference set is constructed, and how many references are available.

图像溯源CLIP零样本生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。