arXiv:2409.12997cs.LGcs.AI2024-09被引 2

用漏洞感知与好奇驱动机制,提升自动驾驶抗攻击能力。

VCAT: Vulnerability-aware and Curiosity-driven Adversarial Training for Enhancing Autonomous Vehicle Robustness

  • 通过代理网络识别自动驾驶系统漏洞,引导攻击者探索新威胁。
  • 在关键场景中训练自动驾驶,使攻击行为更具挑战性,降低事故率。
  • 适合研究自动驾驶安全、强化学习对抗训练的开发者。

自动驾驶车辆在复杂交通环境中面临严重安全威胁。对抗训练已成为提升其抵御恶意攻击鲁棒性的有效方法:通过训练一个对抗策略的交通车辆攻击者,使自动驾驶系统在交互中学习稳健驾驶。然而,现有方法中的对抗策略常陷入对已知漏洞的过度利用,导致自动驾驶性能提升有限。为此,本文提出首个漏洞感知与好奇驱动的对抗训练框架(VCAT)。在攻击者训练阶段,采用代理网络拟合自动驾驶系统的价值函数,获取其内在脆弱性的密集信息;随后使用随机网络蒸馏量化环境新颖性,构建内在奖励以引导攻击者探索未覆盖区域。在防御训练阶段,将预训练的攻击者置于自动驾驶周围,在关键场景中生成攻击行为进行训练。实验表明,VCAT显著提升了基于学习的自动驾驶系统的鲁棒控制能力,优于传统训练方式及其它强化学习方法,事故率明显下降。代码开源:https://github.com/caixxuan/VCAT。

原文摘要 · Abstract (English)

Autonomous vehicles (AVs) face significant threats to their safe operation in complex traffic environments. Adversarial training has emerged as an effective method of enabling AVs to preemptively fortify their robustness against malicious attacks. Train an attacker using an adversarial policy, allowing the AV to learn robust driving through interaction with this attacker. However, adversarial policies in existing methodologies often get stuck in a loop of overexploiting established vulnerabilities, resulting in poor improvement for AVs. To overcome the limitations, we introduce a pioneering framework termed Vulnerability-aware and Curiosity-driven Adversarial Training (VCAT). Specifically, during the traffic vehicle attacker training phase, a surrogate network is employed to fit the value function of the AV victim, providing dense information about the victim's inherent vulnerabilities. Subsequently, random network distillation is used to characterize the novelty of the environment, constructing an intrinsic reward to guide the attacker in exploring unexplored territories. In the victim defense training phase, the AV is trained in critical scenarios in which the pretrained attacker is positioned around the victim to generate attack behaviors. Experimental results revealed that the training methodology provided by VCAT significantly improved the robust control capabilities of learning-based AVs, outperforming both conventional training modalities and alternative reinforcement learning counterparts, with a marked reduction in crash rates. The code is available at https://github.com/caixxuan/VCAT.

自动驾驶对抗训练强化学习安全增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。