通过量化特征共享度,可提前预测迁移攻击成功率。
Towards Predicting the Success of Transfer-based Attacks by Quantifying Shared Feature Representations
- 将源与目标模型特征投影至低维流形,比较其结构相似性。
- 特征相似性与攻击成功率相关系数达0.56,显著提升预测能力。
- 无需模型细节即可预测攻击效果,适用于多种场景。
针对黑盒视觉模型的迁移攻击(TBA)成功原因已有大量研究,但缺乏事前预测方法。本文首次尝试基于目标模型中是否存在脆弱特征来预测攻击成功率。受Chen和Liu(2024)提出的流形攻击框架启发,我们提出新方法:首先将源模型与目标模型在ImageNet上训练的特征向量投影到同一低维流形空间;其次量化该空间中的结构相似性;最后将相似性与攻击成功率关联。实验发现,共享特征表示与攻击成功率呈中度正相关(r=0.56)。该方法无需模型权重、训练细节或架构信息,即可预测攻击能否成功。结果证实不同规模与复杂度的特征提取器间存在共享特征表示,并表明来自不同目标域的数据集可作为解析黑盒特征表示的有效测试信号。
原文摘要 · Abstract (English)
Much effort has been made to explain and improve the success of transfer-based attacks (TBA) on black-box computer vision models. This work provides the first attempt at a priori prediction of attack success by identifying the presence of vulnerable features within target models. Recent work by Chen and Liu (2024) proposed the manifold attack model, a unifying framework proposing that successful TBA exist in a common manifold space. Our work experimentally tests the common manifold space hypothesis by a new methodology: first, projecting feature vectors from surrogate and target feature extractors trained on ImageNet onto the same low-dimensional manifold; second, quantifying any observed structure similarities on the manifold; and finally, by relating these observed similarities to the success of the TBA. We find that shared feature representation moderately correlates with increased success of TBA (\r{ho}= 0.56). This method may be used to predict whether an attack will transfer without information of the model weights, training, architecture or details of the attack. The results confirm the presence of shared feature representations between two feature extractors of different sizes and complexities, and demonstrate the utility of datasets from different target domains as test signals for interpreting black-box feature representations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。