针对端到端自动驾驶模型,提出模块自适应对抗训练方法。
Module-wise Adaptive Adversarial Training for End-to-end Autonomous Driving

- 按模块注入噪声,统一优化整体目标
- 动态调整各模块损失权重,提升训练平衡性
- 在nuScenes和CARLA上验证效果,抗干扰能力显著增强
深度学习的进展显著提升了自动驾驶(AD)模型性能,尤其是集成感知、预测与规划的端到端系统。然而,这些模型仍易受对抗攻击影响,微小扰动即可导致决策失误。尽管对抗训练能增强鲁棒性,但此前未有研究将其应用于端到端自动驾驶模型。本文首次探索该方向,提出模块自适应对抗训练(MA2T)。针对不同模块目标各异且强耦合的问题,MA2T引入模块级噪声注入,于各模块输入前施加噪声,以整体目标为导向进行训练;同时提出动态权重累积适配机制,基于各模块累积的损失下降率自适应调整其损失权重,实现更均衡的训练。在广泛使用的nuScenes数据集上,对多个端到端模型进行白盒与黑盒攻击测试,本方法性能领先基线5-10%;在CARLA仿真环境中闭环评估也显示对自然退化具有更强鲁棒性。
原文摘要 · Abstract (English)
Recent advances in deep learning have markedly improved autonomous driving (AD) models, particularly end-to-end systems that integrate perception, prediction, and planning stages, achieving state-of-the-art performance. However, these models remain vulnerable to adversarial attacks, where human-imperceptible perturbations can disrupt decision-making processes. While adversarial training is an effective method for enhancing model robustness against such attacks, no prior studies have focused on its application to end-to-end AD models. In this paper, we take the first step in adversarial training for end-to-end AD models and present a novel Module-wise Adaptive Adversarial Training (MA2T). However, extending conventional adversarial training to this context is highly non-trivial, as different stages within the model have distinct objectives and are strongly interconnected. To address these challenges, MA2T first introduces Module-wise Noise Injection, which injects noise before the input of different modules, targeting training models with the guidance of overall objectives rather than each independent module loss. Additionally, we introduce Dynamic Weight Accumulation Adaptation, which incorporates accumulated weight changes to adaptively learn and adjust the loss weights of each module based on their contributions (accumulated reduction rates) for better balance and robust training. To demonstrate the efficacy of our defense, we conduct extensive experiments on the widely-used nuScenes dataset across several end-to-end AD models under both white-box and black-box attacks, where our method outperforms other baselines by large margins (+5-10%). Moreover, we validate the robustness of our defense through closed-loop evaluation in the CARLA simulation environment, showing improved resilience even against natural corruption.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。