攻击者可同时骗过视觉Transformer及其解释模型,导致安全误判。
Breaking the Illusion of Security via Interpretation: Interpretable Vision Transformer Systems under Attack
- 设计攻击方法AdViT,让对抗样本同时欺骗模型与解释系统。
- 白盒下攻击成功率100%,误分类置信度达98%;黑盒下仍达76%。
- 生成的解释结果看似合理,使攻击更难被发现,适合安全敏感场景研究。
视觉变换器(ViT)模型结合解释模型被认为具有高安全性,适用于医疗、自动驾驶等关键领域。然而,现有攻击多关注最小扰动,忽视对解释结果的影响。本文提出一种新攻击方法AdViT,可同时误导ViT模型及其耦合的解释模型。在多种ViT模型和两种基于变压器的解释器上测试,AdViT在白盒和黑盒场景下均实现100%攻击成功率。白盒下误分类置信度最高达98%,黑盒下达76%。令人震惊的是,该攻击始终生成看似准确的解释,显著增强隐蔽性,使对抗样本更难被检测。
原文摘要 · Abstract (English)
Vision transformer (ViT) models, when coupled with interpretation models, are regarded as secure and challenging to deceive, making them well-suited for security-critical domains such as medical applications, autonomous vehicles, drones, and robotics. However, successful attacks on these systems can lead to severe consequences. Recent research on threats targeting ViT models primarily focuses on generating the smallest adversarial perturbations that can deceive the models with high confidence, without considering their impact on model interpretations. Nevertheless, the use of interpretation models can effectively assist in detecting adversarial examples. This study investigates the vulnerability of transformer models to adversarial attacks, even when combined with interpretation models. We propose an attack called "AdViT" that generates adversarial examples capable of misleading both a given transformer model and its coupled interpretation model. Through extensive experiments on various transformer models and two transformer-based interpreters, we demonstrate that AdViT achieves a 100% attack success rate in both white-box and black-box scenarios. In white-box scenarios, it reaches up to 98% misclassification confidence, while in black-box scenarios, it reaches up to 76% misclassification confidence. Remarkably, AdViT consistently generates accurate interpretations in both scenarios, making the adversarial examples more difficult to detect.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。