首次系统评估AI图像指纹在对抗攻击下的鲁棒性,发现现有方法易被擦除或伪造。
Smudged Fingerprints: A Systematic Evaluation of the Robustness of AI Image Fingerprints
- 构建白盒与黑盒攻击模型,针对指纹移除和伪造两类威胁进行测试。
- 指纹移除攻击在白盒下成功率超80%,黑盒下也达50%以上。
- 准确率高的指纹方法往往脆弱,无技术能在所有攻击下同时保持高鲁棒性和准确性。
模型指纹检测在追溯生成图像来源方面展现出潜力,但现有评估极少考虑其对抗性场景。本文首次系统性地评估了该类技术的安全性,形式化定义了包含白盒与黑盒访问的威胁模型,以及两大攻击目标:指纹移除(擦除标识以逃避溯源)与指纹伪造(诱导错误归因至目标模型)。我们实现五种攻击策略,对14种代表性指纹方法在RGB、频域及学习特征域上,于12个前沿图像生成器上进行评估。实验揭示干净样本与对抗样本间性能差距显著:移除攻击在白盒下成功率超过80%,黑盒下亦超50%;伪造虽更难,但成功率因目标模型而异。同时观察到实用性和鲁棒性间的权衡:高准确率的方法通常易受攻击;尽管部分方法在特定场景下表现稳健,但尚无一能全面兼顾鲁棒性与准确性。研究强调需发展平衡二者的新技术,并指出了最有前景的方向。代码已开源:https://github.com/kaikaiyao/SmudgedFingerprints。
原文摘要 · Abstract (English)
Model fingerprint detection has shown promise to trace the provenance of AI-generated images in forensic applications. However, despite the inherent adversarial nature of these applications, existing evaluations rarely consider adversarial settings. We present the first systematic security evaluation of these techniques, formalizing threat models that encompass both white- and black-box access and two attack goals: fingerprint removal, which erases identifying traces to evade attribution, and fingerprint forgery, which seeks to cause misattribution to a target model. We implement five attack strategies and evaluate 14 representative fingerprinting methods across RGB, frequency, and learned-feature domains on 12 state-of-the-art image generators. Our experiments reveal a pronounced gap between clean and adversarial performance. Removal attacks are highly effective, often achieving success rates above 80% in white-box settings and over 50% under black-box access. While forgery is more challenging than removal, its success varies significantly across targeted models. We also observe a utility-robustness trade-off: accurate attribution methods are often vulnerable to attacks and, although some techniques are robust in specific settings, none achieves robustness and accuracy across all evaluated threat models. These findings highlight the need for techniques that balance robustness and accuracy, and we identify the most promising approaches toward this goal. Code available at: https://github.com/kaikaiyao/SmudgedFingerprints.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。