arXiv:2409.10562cs.CVcs.SE2024-09中稿 · the 19th IEEE Inte…

用真实路旁物体位置生成对抗样本,测试自动驾驶感知系统漏洞

Natural Adversaries: Fuzzing Autonomous Vehicles with Realistic Roadside Object Placements

  • 通过调整垃圾桶等路旁物体位置,生成符合道路规范的对抗场景
  • 在阿波罗系统上触发15种交通法规违规,误判率显著
  • 黑盒攻击无需特殊贴纸,结果更贴近真实世界威胁

自动驾驶车辆感知系统需具备抗干扰能力。现有测试多依赖显眼形状或对抗贴片,但这类攻击不具现实性。本文提出一种黑盒攻击方法TrashFuzz,通过调整常见路旁物体(如垃圾桶、广告牌)的位置,在满足道路设计规范的前提下,诱导自动驾驶系统产生严重误判,例如错误识别红绿灯颜色,从而引发交通违法。该方法不使用“不自然”的对抗贴片,仅改变物体布局。我们在阿波罗自动驾驶系统上评估,成功触发24种交通法规中的15种违规,验证了其有效性与现实威胁。

原文摘要 · Abstract (English)

The emergence of Autonomous Vehicles (AVs) has spurred research into testing the resilience of their perception systems, i.e., ensuring that they are not susceptible to critical misjudgements. It is important that these systems are tested not only with respect to other vehicles on the road, but also with respect to objects placed on the roadside. Trash bins, billboards, and greenery are examples of such objects, typically positioned according to guidelines developed for the human visual system, which may not align perfectly with the needs of AVs. Existing tests, however, usually focus on adversarial objects with conspicuous shapes or patches, which are ultimately unrealistic due to their unnatural appearance and reliance on white-box knowledge. In this work, we introduce a black-box attack on AV perception systems that creates realistic adversarial scenarios (i.e., satisfying road design guidelines) by manipulating the positions of common roadside objects and without resorting to "unnatural" adversarial patches. In particular, we propose TrashFuzz, a fuzzing algorithm that finds scenarios in which the placement of these objects leads to substantial AV misperceptions -- such as mistaking a traffic light's colour -- with the overall goal of causing traffic-law violations. To ensure realism, these scenarios must satisfy several rules encoding regulatory guidelines governing the placement of objects on public streets. We implemented and evaluated these attacks on the Apollo autonomous driving system, finding that TrashFuzz induced violations of 15 out of 24 traffic laws.

自动驾驶对抗攻击路侧物体真实场景

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。