提出新型对抗性后门攻击,让强化学习在受限奖励下仍能成功植入恶意行为。
Adversarial Inception Backdoor Attacks against Reinforcement Learning
- 通过修改训练数据注入触发器并替换高回报动作实现攻击
- 在约束奖励下对多个环境实现100%攻击成功率
- 适合研究安全强化学习或防御后门的学者参考
近期工作已揭示深度强化学习(DRL)在训练阶段遭受后门投毒攻击的脆弱性。此类攻击的目标是:在部署时一旦观察到特定触发器,便诱导智能体产生预设的恶意行为,同时在训练期间仍能完成本应任务。现有攻击假设可任意操控智能体奖励,导致其超出环境自然约束,因而一旦施加合理奖励限制即失效。本文提出一类全新的后门攻击——“inception”攻击,是首个在严格奖励约束下达到顶尖性能的攻击方法。该攻击通过操纵训练数据,在先前观测中插入触发器,并将高回报动作替换为目标恶意行为。我们形式化定义了此类攻击,并证明其在任意马尔可夫决策过程(MDP)上均能满足双重目标。基于此框架,我们设计了一种在线式inception攻击,在多个环境中实现100%攻击成功率,且对智能体正常任务表现影响极小。
原文摘要 · Abstract (English)
Recent works have demonstrated the vulnerability of Deep Reinforcement Learning (DRL) algorithms against training-time, backdoor poisoning attacks. The objectives of these attacks are twofold: induce pre-determined, adversarial behavior in the agent upon observing a fixed trigger during deployment while allowing the agent to solve its intended task during training. Prior attacks assume arbitrary control over the agent's rewards, inducing values far outside the environment's natural constraints. This results in brittle attacks that fail once the proper reward constraints are enforced. Thus, in this work we propose a new class of backdoor attacks against DRL which are the first to achieve state of the art performance under strict reward constraints. These "inception" attacks manipulate the agent's training data -- inserting the trigger into prior observations and replacing high return actions with those of the targeted adversarial behavior. We formally define these attacks and prove they achieve both adversarial objectives against arbitrary Markov Decision Processes (MDP). Using this framework we devise an online inception attack which achieves an 100\% attack success rate on multiple environments under constrained rewards while minimally impacting the agent's task performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。