arXiv:2511.14876cs.CRcs.CV2025-11被引 1

用真实驾驶场景测试对抗攻击,发现部分攻击可让自动驾驶失效。

Attacking Autonomous Driving Agents with Adversarial Machine Learning: A Holistic Evaluation with the CARLA Leaderboard

  • 在CARLA仿真中实时注入对抗补丁,测试多种驾驶代理
  • 部分攻击导致错误停车或转向,但部分代理能通过控制模块纠正
  • 无需修改代码,评估了真实竞赛中的最优驾驶系统

为实现车辆自主控制,驾驶代理依赖机器学习模型、控制器逻辑和定制模块的组合输出。尽管已有大量研究证明对抗样本可误导自动驾驶中的机器学习模型,但这些攻击是否能在不同代理、环境与场景下引发有害驾驶行为仍不明确。为评估对抗样本对自动驾驶的风险,本文评估了针对多种驾驶代理的攻击,而非孤立地针对机器学习模型。为此,我们利用城市驾驶模拟器CARLA生成并评估对抗样本。通过在运行时向CARLA注入设计用于迫使驾驶代理停车或转向的对抗补丁,评估其在CARLA Leaderboard(年度研究竞赛中最佳驾驶代理的公开仓库)上的表现。与以往工作不同,本研究在不修改任何驾驶代理代码的前提下,对其完整系统(包括机器学习模型在内的所有组件)进行攻击评估。我们对两种攻击策略在三个开源驾驶代理上进行了案例研究,覆盖多个驾驶场景、光照条件和地理位置。结果表明,虽然某些攻击能成功误导机器学习模型生成错误的停车或转向指令,但部分驾驶代理使用如PID控制或基于GPS的规则等模块,能够覆盖攻击者操纵的预测结果。

原文摘要 · Abstract (English)

To autonomously control vehicles, driving agents use outputs from a combination of machine-learning (ML) models, controller logic, and custom modules. Although numerous prior works have shown that adversarial examples can mislead ML models used in autonomous driving contexts, it remains unclear if these attacks are effective at producing harmful driving actions for various agents, environments, and scenarios. To assess the risk of adversarial examples to autonomous driving, we evaluate attacks against a variety of driving agents, rather than against ML models in isolation. To support this evaluation, we leverage CARLA, an urban driving simulator, to create and evaluate adversarial examples. We create adversarial patches designed to stop or steer driving agents, stream them into the CARLA simulator at runtime, and evaluate them against agents from the CARLA Leaderboard, a public repository of best-performing autonomous driving agents from an annual research competition. Unlike prior work, we evaluate attacks against autonomous driving systems without creating or modifying any driving-agent code and against all parts of the agent included with the ML model. We perform a case-study investigation of two attack strategies against three open-source driving agents from the CARLA Leaderboard across multiple driving scenarios, lighting conditions, and locations. Interestingly, we show that, although some attacks can successfully mislead ML models into predicting erroneous stopping or steering commands, some driving agents use modules, such as PID control or GPS-based rules, that can overrule attacker-manipulated predictions from ML models.

自动驾驶对抗攻击仿真测试CARLA

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。