为自动驾驶感知系统提供可解释的故障监测,提升安全可靠性。
Explaining Unreliable Perception in Automated Driving: A Fuzzy-based Monitoring Approach
- 基于模糊逻辑构建感知可靠性监控器,可解释环境条件影响。
- 在真实驾驶数据中验证,显著降低危险场景发生率。
- 适合关注自动驾驶安全与可解释性的研究人员和工程师。
依赖机器学习(ML)的自主系统采用运行时监控等容错机制,以检测预测错误并保障运行安全。然而,缺乏对错误的人类可理解解释,阻碍了系统安全性与可靠性的充分保证。本文提出一种专用于ML感知组件的新型模糊监控方法,不仅能提供运行时安全监控,还能解释不同运行条件如何影响感知可靠性。我们在自然驾驶数据集上开展自动驾驶案例研究,评估了该监控器的可解释性,并识别出感知组件表现可靠的操作条件。此外,我们构建了从单元级正确性证据到系统级安全性的保证链。基准测试表明,在所用数据集中,相比现有最优运行时监控方法,本方法在保持任务可用性的同时,显著提升了安全性(即减少了危险情境的发生)。
原文摘要 · Abstract (English)
Autonomous systems that rely on Machine Learning (ML) utilize online fault tolerance mechanisms, such as runtime monitors, to detect ML prediction errors and maintain safety during operation. However, the lack of human-interpretable explanations for these errors can hinder the creation of strong assurances about the system's safety and reliability. This paper introduces a novel fuzzy-based monitor tailored for ML perception components. It provides human-interpretable explanations about how different operating conditions affect the reliability of perception components and also functions as a runtime safety monitor. We evaluated our proposed monitor using naturalistic driving datasets as part of an automated driving case study. The interpretability of the monitor was evaluated and we identified a set of operating conditions in which the perception component performs reliably. Additionally, we created an assurance case that links unit-level evidence of \textit{correct} ML operation to system-level \textit{safety}. The benchmarking demonstrated that our monitor achieved a better increase in safety (i.e., absence of hazardous situations) while maintaining availability (i.e., ability to perform the mission) compared to state-of-the-art runtime ML monitors in the evaluated dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。