构建首个覆盖多领域生成图像的溯源基准,揭示现有方法泛化能力严重不足。
ImageAttributionBench: How Far Are We from Generalizable Attribution?

- 构建涵盖多种生成模型与语义场景的大规模图像溯源数据集
- 在退化图像和跨语义域测试中,现有方法准确率均低于40%
- 为图像溯源研究提供真实世界挑战下的严格评估标准
生成式AI的快速发展催生了高度逼真且多样化的合成图像,对图像溯源与虚假信息检测构成严峻挑战,亟需有效的图像溯源技术。然而,现有溯源数据集受限于规模小、生成方法过时及语义多样性不足,难以支撑鲁棒且可泛化的溯源模型发展。为此,我们提出ImageAttributionBench,一个全面的数据集,包含由多种先进生成模型(采用SOTA架构)生成的图像,覆盖多个现实语义领域,具备丰富的多样性与规模,以推动图像溯源研究进展。为模拟真实溯源场景,我们在两个挑战性设置下评估了几种SOTA溯源方法:(1) 在标准平衡划分上训练,在退化图像上测试;(2) 在语义不重叠的划分上训练与测试。结果表明,当前方法在两种情况下均表现不佳,揭示其在鲁棒性与未见语义内容泛化方面存在显著局限。本工作为未来图像溯源方法的开发与评估提供了严谨基准。
原文摘要 · Abstract (English)
The rapid advancement of generative AI has enabled the creation of highly realistic and diverse synthetic images, posing critical challenges for image provenance and misinformation detection. This underscores the urgent need for effective image attribution. However, existing attribution datasets are constrained by limited scale, outdated generation methods, and insufficient semantic diversity - hindering the development of robust and generalizable attribution models. To address these limitations, we introduce ImageAttributionBench, a comprehensive dataset comprising images synthesized by a wide array of advanced generative models with state-of-the-art (SOTA) architectures. Covering multiple real-world semantic domains, the dataset offers rich diversity and scale to support and accelerate progress in image attribution research. To simulate real-world attribution scenarios, we evaluate several SOTA attribution methods on ImageAttributionBench under two challenging settings: (1) training on a standard balanced split and testing on degraded images, and (2) training and testing on semantically disjoint splits. In both cases, current methods exhibit consistently poor performance, revealing significant limitations in their robustness and generalization to unseen semantic content. Our work provides a rigorous benchmark to facilitate the development and evaluation of future image attribution methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。