arXiv:2607.04953cs.SEcs.RO2026-07

实测自动驾驶系统在真实路况下的抗干扰能力,发现仿真测试结果难反映实际表现。

Real-World Perturbation Testing of Autonomous Driving Systems

论文配图:Real-World Perturbation Testing of Autonomous Driving Systems
图 1 · 摘自论文原文
  • 在真实车辆上测试72种传感器扰动,涵盖摄像头与激光雷达系统。
  • 仿真中影响小的扰动,现实中仍会导致失控或系统失效。
  • 仅靠模型级指标无法识别最危险的扰动,需结合闭环实测。

自动驾驶系统需在多变环境下可靠运行,但罕见或恶劣场景的数据难以获取。基于扰动的测试广泛用于评估鲁棒性,但多数研究聚焦离线数据集或仿真,未验证其在真实驾驶中的有效性。本文开展大规模实测,对72种摄像头和激光雷达扰动进行三类测试:离线模型分析、软硬件协同执行、全尺寸自动驾驶车闭环系统测试。覆盖端到端视觉驱动模型与模块化激光雷达感知规划架构。结果揭示测试层级间存在明显差距:摄像头系统中,离线影响小的扰动仍会引发实际驾驶中的控制不稳定与故障;激光雷达系统虽感知退化较一致,但难预测系统级失败。两类系统均表明,仅依赖模型级指标无法识别最具破坏性的扰动。进一步发现实时可行性是真实测试的关键约束,且由记录数据得出的鲁棒性结论无法稳定转移到物理车辆的闭环行为中,强调必须结合真实世界、系统级评估。

原文摘要 · Abstract (English)

Autonomous Driving Systems (ADS) must operate reliably under diverse conditions, yet representative data for rare or adverse scenarios is difficult to obtain. Perturbation-based testing is widely used to assess robustness, but most studies focus on offline datasets or simulation, leaving open questions about how such results translate to real-world driving. We present a large-scale study of 72 camera and LiDAR perturbations, evaluated across three testing modalities: offline model-level analysis, hardware-in-the-loop execution, and closed-loop system-level testing on a full-scale autonomous vehicle. The study covers both an end-to-end vision-based driving model and a modular LiDAR-based perception and planning stack. Our results reveal a clear gap between testing levels. For camera-based systems, perturbations with limited offline impact can still induce unstable control and failures in real-world driving. For LiDAR-based systems, degradation is more consistent at the perception level but weakly predictive of system-level failures. Across both modalities, model-level metrics alone are insufficient to identify the most harmful perturbations. We further show that real-time feasibility is a key constraint in real-world testing, and that robustness observations obtained from recorded data do not consistently transfer to closed-loop behavior on a physical vehicle, highlighting the importance of complementary real-world, system-level evaluation.

自动驾驶系统测试真实场景鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。