arXiv:2510.09041cs.LGcs.AI2025-10被引 1

用智能对抗强化学习提升自动驾驶抗攻击能力,让系统更安全可靠。

Robust Driving Control for Autonomous Vehicles: An Intelligent General-sum Constrained Adversarial Reinforcement Learning Approach

  • 设计可多步协同的策略型对抗者,模拟真实威胁场景。
  • 在仿真中使攻击成功率达27.9%以上,显著优于现有方法。
  • 适合关注自动驾驶安全与鲁棒性研究的工程师和研究人员。

深度强化学习(DRL)在自动驾驶策略开发中表现卓越,但其对对抗攻击的脆弱性仍是实际部署的关键障碍。现有鲁棒方法仍存在三大问题:(i) 仅针对短视攻击训练,难以应对更具策略性的威胁;(ii) 难以引发真正的安全事故(如碰撞),常导致轻微后果;(iii) 缺乏稳健约束,易引发训练不稳定与策略漂移。为此,本文提出智能广义约束对抗强化学习(IGCARL),包含一个具备时序决策能力的战略性目标对抗者与一个鲁棒驾驶智能体。该对抗者利用DRL实现多步协同攻击,并通过广义目标明确诱导安全关键事件。驾驶智能体通过与对抗者交互学习,构建抗攻击策略。为保障对抗环境下的稳定训练并缓解策略漂移,采用约束优化框架。大量实验表明,IGCARL相较最先进方法攻击成功率提升至少27.9%,显著增强DRL驱动自动驾驶的安全性与可靠性。

原文摘要 · Abstract (English)

Deep reinforcement learning (DRL) has demonstrated remarkable success in developing autonomous driving policies. However, its vulnerability to adversarial attacks remains a critical barrier to real-world deployment. Although existing robust methods have achieved success, they still suffer from three key issues: (i) these methods are trained against myopic adversarial attacks, limiting their abilities to respond to more strategic threats, (ii) they have trouble causing truly safety-critical events (e.g., collisions), but instead often result in minor consequences, and (iii) these methods can introduce learning instability and policy drift during training due to the lack of robust constraints. To address these issues, we propose Intelligent General-sum Constrained Adversarial Reinforcement Learning (IGCARL), a novel robust autonomous driving approach that consists of a strategic targeted adversary and a robust driving agent. The strategic targeted adversary is designed to leverage the temporal decision-making capabilities of DRL to execute strategically coordinated multi-step attacks. In addition, it explicitly focuses on inducing safety-critical events by adopting a general-sum objective. The robust driving agent learns by interacting with the adversary to develop a robust autonomous driving policy against adversarial attacks. To ensure stable learning in adversarial environments and to mitigate policy drift caused by attacks, the agent is optimized under a constrained formulation. Extensive experiments show that IGCARL improves the success rate by at least 27.9% over state-of-the-art methods, demonstrating superior robustness to adversarial attacks and enhancing the safety and reliability of DRL-based autonomous driving.

自动驾驶对抗学习强化学习安全控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。