提出感知距离度量方法,量化自动驾驶系统在复杂条件下的感知稳定性。
Perception Characteristics Distance: Measuring Stability and Robustness of Perception System in Dynamic Conditions under a Certain Decision Rule
- 引入感知特性距离PCD,基于最远可靠检测距离衡量模型不确定性。
- aPCD在雨天、夜间等条件下显著差异,传统指标无法捕捉此变化。
- 适合评估自动驾驶感知系统的鲁棒性,尤其关注极端环境下的可靠性。
自动驾驶系统的安全性依赖于不同距离和驾驶条件下的精准感知。当前的感知评估指标未能反映人工智能感知算法输出的随机性,而这种随机性对决策与安全结果(如碰撞时间估计)有重大影响。本文提出感知特性距离(Perception Characteristics Distance, PCD),将模型输出不确定性以最远可靠检测距离的形式纳入衡量。为表征系统整体感知能力,我们对多个检测质量与概率阈值下的PCD取平均,得到平均感知特性距离(aPCD)。通过在弗吉尼亚智能道路采集的SensorRainFall数据集进行实证验证,该数据集使用配备摄像头、雷达和激光雷达的车辆,在晴天与雨天、白天、路灯与夜间等多种光照条件下采集,包含目标物体的真实距离、边界框与分割掩码。实验表明,aPCD能有效区分不同天气与光照条件下的性能差异,而传统指标则无法体现这些变化。PCD提供了考虑不确定性的感知性能度量方式,有助于实现更安全、更鲁棒的自动驾驶系统运行。SensorRainFall数据集已公开于Kaggle,评估代码发布于GitHub。
原文摘要 · Abstract (English)
The safety of autonomous driving systems (ADS) depends on accurate perception across distance and driving conditions. The outputs of AI perception algorithms are stochastic, which have a major impact on decision making and safety outcomes, including time-to-collision estimation. However, current perception evaluation metrics do not reflect the stochastic nature of perception algorithms. We introduce the Perception Characteristics Distance (PCD), a novel metric incorporating model output uncertainty as represented by the farthest distance at which an object can be reliably detected. To represent a system's overall perception capability in terms of reliable detection distance, we average PCD values across multiple detection quality and probabilistic thresholds to produce the average PCD (aPCD). For empirical validation, we present the SensorRainFall dataset, collected on the Virginia Smart Road using a sensor-equipped vehicle (cameras, radar, and LiDAR) under different weather (clear and rainy) and illumination conditions (daylight, streetlight, and nighttime). The dataset includes ground-truth distances, bounding boxes, and segmentation masks for target objects. Experiments with state-of-the-art models show that aPCD captures meaningful differences across weather, daylight, and illumination conditions, which traditional evaluation metrics fail to reflect. PCD provides an uncertainty-aware measure of perception performance, supporting safer and more robust ADS operation, while the SensorRainFall dataset offers a valuable benchmark for evaluation. The SensorRainFall dataset is publicly available at https://www.kaggle.com/datasets/datadrivenwheels/sensorrainfall, and the evaluation code is available at https://github.com/datadrivenwheels/PCD_Python.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。