利用解释信息替换关键特征,实现高效隐蔽的黑盒模型攻击
XSub: Explanation-Driven Adversarial Attack against Blackbox Classifiers via Feature Substitution
- 通过XAI识别重要特征,用其他类别的'黄金样本'特征替换
- 攻击成功率高且查询次数仅需常数级别,成本极低
- 可扩展为后门攻击,适合研究模型安全与防御的学者
尽管可解释人工智能(XAI)在提升AI系统透明度和可信度方面具有显著优势,但其在实际应用中尚未充分发挥潜力。一个关键挑战是,XAI可能无意间为攻击者提供黑盒模型的洞察,从而增加模型面临各类攻击的风险。本文提出一种基于特征替换的新型解释驱动对抗攻击方法XSub,通过将原始样本中由XAI识别的重要特征,替换为另一类别'黄金样本'中的对应重要特征,从而提高模型对扰动样本的误分类概率。特征替换程度可调,可在攻击效果与隐蔽性之间灵活权衡。XSub仅需O(1)次对预测模型和解释模型的查询,具有极高成本效益。此外,若攻击者获得训练数据,该方法还可轻松扩展为后门攻击。实验表明,XSub不仅高效隐蔽,且成本低廉,适用于多种AI模型。
原文摘要 · Abstract (English)
Despite its significant benefits in enhancing the transparency and trustworthiness of artificial intelligence (AI) systems, explainable AI (XAI) has yet to reach its full potential in real-world applications. One key challenge is that XAI can unintentionally provide adversaries with insights into black-box models, inevitably increasing their vulnerability to various attacks. In this paper, we develop a novel explanation-driven adversarial attack against black-box classifiers based on feature substitution, called XSub. The key idea of XSub is to strategically replace important features (identified via XAI) in the original sample with corresponding important features from a "golden sample" of a different label, thereby increasing the likelihood of the model misclassifying the perturbed sample. The degree of feature substitution is adjustable, allowing us to control how much of the original samples information is replaced. This flexibility effectively balances a trade-off between the attacks effectiveness and its stealthiness. XSub is also highly cost-effective in that the number of required queries to the prediction model and the explanation model in conducting the attack is in O(1). In addition, XSub can be easily extended to launch backdoor attacks in case the attacker has access to the models training data. Our evaluation demonstrates that XSub is not only effective and stealthy but also cost-effective, enabling its application across a wide range of AI models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。