arXiv:2510.07749cs.RO2025-10

将自动驾驶感知故障抽象为幻觉,实现跨组件安全评估。

Injecting Hallucinations in Autonomous Vehicles: A Component-Agnostic Safety Evaluation Framework

  • 将感知故障定义为可观察的幻觉,摆脱具体传感器和算法依赖。
  • 在18,350次仿真中验证六类幻觉,发现感知延迟与漂移显著增加碰撞风险。
  • 框架可适配新架构,加速自动驾驶安全验证,适合研发与评测团队。

自动驾驶车辆(AV)的感知失败仍是重大安全隐患,因它们是诸多事故的基础。现有研究常对单一传感器或机器感知(MP)模块注入人工故障,导致框架孤立,难以泛化或集成至统一仿真环境。本文将感知失败重构为‘幻觉’——即扭曲车辆态势感知的虚假感知,可能引发不安全控制行为。由于幻觉仅描述可观测效应,该抽象使分析独立于具体传感器或算法,聚焦其在MP流程中的表现形式。基于此,我们提出一个可配置的、组件无关的幻觉注入框架,在开源模拟器中迭代生成六类合理幻觉。在超过18,350次仿真中,车辆穿越无信号横穿道路且有车流的情境下注入幻觉。结果统计验证了框架有效性,并量化各类幻觉对碰撞与近事故的影响。某些幻觉如感知延迟与漂移显著提升碰撞风险,验证了该范式能有效测试系统安全性。该框架提供可扩展、统计验证、组件无关且完全互操作的工具集,简化并加速自动驾驶安全验证,尤其适用于新型MP架构,有望缩短产品上市周期,并为未来容错与鲁棒设计研究奠定基础。

原文摘要 · Abstract (English)

Perception failures in autonomous vehicles (AV) remain a major safety concern because they are the basis for many accidents. To study how these failures affect safety, researchers typically inject artificial faults into hardware or software components and observe the outcomes. However, existing fault injection studies often target a single sensor or machine perception (MP) module, resulting in siloed frameworks that are difficult to generalize or integrate into unified simulation environments. This work addresses that limitation by reframing perception failures as hallucinations, false perceptions that distort an AV situational awareness and may trigger unsafe control actions. Since hallucinations describe only observable effects, this abstraction enables analysis independent of specific sensors or algorithms, focusing instead on how their faults manifest along the MP pipeline. Building on this concept, we propose a configurable, component-agnostic hallucination injection framework that induces six plausible hallucination types in an iterative open-source simulator. More than 18,350 simulations were executed in which hallucinations were injected while AVs crossed an unsignalized transverse street with traffic. The results statistically validate the framework and quantify the impact of each hallucination type on collisions and near misses. Certain hallucinations, such as perceptual latency and drift, significantly increase the risk of collision in the scenario tested, validating the proposed paradigm can stress the AV system safety. The framework offers a scalable, statistically validated, component agnostic, and fully interoperable toolset that simplifies and accelerates AV safety validations, even those with novel MP architectures and components. It can potentially reduce the time-to-market of AV and lay the foundation for future research on fault tolerance, and resilient AV design.

自动驾驶安全评估幻觉注入仿真验证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。