网络相似性影响对抗攻击迁移成功率,可用来预估新模型的脆弱性。
The Relationship Between Network Similarity and Transferability of Adversarial Attacks
- 用CKA度量网络相似性,分析不同架构间的结构关联。
- 复杂模型如DenseNet相似性更低,且更易受迁移攻击影响。
- 决策树模型能以90%以上准确率预测迁移攻击成功率,适合安全评估。
神经网络易受对抗攻击,设计鲁棒网络面临挑战。本文研究网络相似性与对抗攻击迁移成功率之间的关系,为网络设计者提供新模型脆弱性评估依据。采用中心核对齐(CKA)度量多种卷积神经网络(CNN)间的相似性,发现不同架构间相似性中等,复杂模型(如DenseNet)因结构复杂而相似性较低;基础层(如Conv2d、Dropout)相似性高,专用层则差异大。非迁移攻击成功率稳定,但部分迁移攻击结果波动显著,复杂网络更易受影响。实验表明,决策树回归器可对所有黑盒攻击及Carlini & Wagner攻击实现超过90%的迁移成功率预测准确率,说明预测模型在特定条件下可行。然而不同数据子集结果变化大,表明该关系复杂,需进一步研究以推广至更多攻击场景和网络架构。
原文摘要 · Abstract (English)
Neural networks are vulnerable to adversarial attacks, and several defenses have been proposed. Designing a robust network is a challenging task given the wide range of attacks that have been developed. Therefore, we aim to provide insight into the influence of network similarity on the success rate of transferred adversarial attacks. Network designers can then compare their new network with existing ones to estimate its vulnerability. To achieve this, we investigate the complex relationship between network similarity and the success rate of transferred adversarial attacks. We applied the Centered Kernel Alignment (CKA) network similarity score and used various methods to find a correlation between a large number of Convolutional Neural Networks (CNNs) and adversarial attacks. Network similarity was found to be moderate across different CNN architectures, with more complex models such as DenseNet showing lower similarity scores due to their architectural complexity. Layer similarity was highest for consistent, basic layers such as DataParallel, Dropout and Conv2d, while specialized layers showed greater variability. Adversarial attack success rates were generally consistent for non-transferred attacks, but varied significantly for some transferred attacks, with complex networks being more vulnerable. We found that a DecisionTreeRegressor can predict the success rate of transferred attacks for all black-box and Carlini & Wagner attacks with an accuracy of over 90%, suggesting that predictive models may be viable under certain conditions. However, the variability of results across different data subsets underscores the complexity of these relationships and suggests that further research is needed to generalize these findings across different attack scenarios and network architectures.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。