发现并修正自动驾驶3D标注中的系统性误差,提升数据质量超17%。
Correcting and Quantifying Systematic Errors in 3D Box Annotations for Autonomous Driving
- 提出离线估计法,使标注轨迹符合物理规律且与传感器数据时空一致。
- 发现原始标注最大偏差达2.5米,动态物体受影响最严重。
- 验证误差影响超过顶尖模型提升幅度,强调高质量标注对评估至关重要。
精确的真值标注对自动驾驶系统的监督学习与性能评估至关重要。车辆通常配备如LiDAR等主动传感器,以预设模式扫描环境,但在动态场景中,物体在不同时间戳被观测到不同位置,若不妥善处理,将引入系统性标注误差。本文首次在广泛使用的公开数据集(Argoverse 2、MAN TruckScenes及自有的私有数据集)中发现此类问题。通过新颖的离线估计方法,我们修正标注,使其符合物理可行轨迹,并实现与传感器数据的空间时间一致性。首次定义该问题的评估指标,实验显示标注质量提升超过17%。进一步量化误差发现,原始标注最大偏移达2.5米,动态物体受影响最显著。最后测试误差对基准测试的影响,结果表明其影响大于当前先进方法相对于旧方法的提升幅度,证明精准标注对性能解读不可或缺。代码已开源:https://github.com/alexandre-justo-miro/annotation-correction-3D-boxes。
原文摘要 · Abstract (English)
Accurate ground truth annotations are critical to supervised learning and evaluating the performance of autonomous vehicle systems. These vehicles are typically equipped with active sensors, such as LiDAR, which scan the environment in predefined patterns. 3D box annotation based on data from such sensors is challenging in dynamic scenarios, where objects are observed at different timestamps, hence different positions. Without proper handling of this phenomenon, systematic errors are prone to being introduced in the box annotations. Our work is the first to discover such annotation errors in widely used, publicly available datasets. Through our novel offline estimation method, we correct the annotations so that they follow physically feasible trajectories and achieve spatial and temporal consistency with the sensor data. For the first time, we define metrics for this problem; and we evaluate our method on the Argoverse 2, MAN TruckScenes, and our proprietary datasets. Our approach increases the quality of box annotations by more than 17% in these datasets. Furthermore, we quantify the annotation errors in them and find that the original annotations are misplaced by up to 2.5 m, with highly dynamic objects being the most affected. Finally, we test the impact of the errors in benchmarking and find that the impact is larger than the improvements that state-of-the-art methods typically achieve with respect to the previous state-of-the-art methods; showing that accurate annotations are essential for correct interpretation of performance. Our code is available at https://github.com/alexandre-justo-miro/annotation-correction-3D-boxes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。