提出新指标评估自动驾驶感知安全,发现传统指标忽略致命误检
EPSM: A Novel Metric to Evaluate the Safety of Environmental Perception in Autonomous Driving
- 设计轻量级物体安全度量,量化检测错误潜在风险
- 融合车道与物体检测关联性,构建联合安全评分
- 在DeepAccident数据集验证,识别出传统指标遗漏的高危错误
全面评估感知系统对复杂驾驶场景中智能车辆的安全至关重要。传统性能指标如精确率、召回率和F1分数仅衡量整体检测准确率,未考虑感知相关的安全因素。因此,即使这些指标得分高的感知系统,仍可能因误检导致严重事故。故需同时评估感知系统的整体性能与安全性。本文提出一种新型联合评估框架,用于关键感知任务——物体与车道检测。该框架引入轻量级物体安全度量,量化检测错误带来的潜在风险;同时构建包含两任务间依赖关系的车道安全度量。最终的综合安全评分提供统一、可解释的感知安全性能度量。基于DeepAccident数据集的实验表明,本方法能识别出传统性能指标无法捕捉的安全关键误检。研究强调了自动驾驶感知系统采用以安全为中心的评估方法的重要性。
原文摘要 · Abstract (English)
Extensive evaluation of perception systems is crucial for ensuring the safety of intelligent vehicles in complex driving scenarios. Conventional performance metrics such as precision, recall and the F1-score assess the overall detection accuracy, but they do not consider the safety-relevant aspects of perception. Consequently, perception systems that achieve high scores in these metrics may still cause misdetections that could lead to severe accidents. Therefore, it is important to evaluate not only the overall performance of perception systems, but also their safety. We therefore introduce a novel safety metric for jointly evaluating the most critical perception tasks, object and lane detection. Our proposed framework integrates a new, lightweight object safety metric that quantifies the potential risk associated with object detection errors, as well as an lane safety metric including the interdependence between both tasks that can occur in safety evaluation. The resulting combined safety score provides a unified, interpretable measure of perception safety performance. Using the DeepAccident dataset, we demonstrate that our approach identifies safety critical perception errors that conventional performance metrics fail to capture. Our findings emphasize the importance of safety-centric evaluation methods for perception systems in autonomous driving.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。