首个在线高精地图稳定性基准,揭示准确率与稳定性相互独立
Stability Under Scrutiny: Benchmarking Representation Paradigms for Online HD Mapping
- 提出多维度稳定性评估框架,包含存在、定位、形状三项新指标
- 42个模型实测显示准确率与稳定性无强相关性,可分别优化
- 适合关注自动驾驶地图可靠性与系统鲁棒性的研究者和工程师
在线高精地图是自动驾驶的核心模块,具备成本低、实时性强的优势。但车载传感器在动态环境中常因空间位移导致地图结果漂移,严重影响下游任务。现有方法多聚焦单帧精度提升,对时间稳定性缺乏系统研究。本文首次构建全面的在线高精地图稳定性基准,提出包含存在性、定位性、形状性稳定性的多维评估框架,并整合为统一的平均稳定度(mAS)得分。在42个模型及其变体上开展实验,发现准确率(mAP)与稳定性(mAS)代表截然不同的性能维度。进一步分析模型设计对两类指标的影响,识别出提升准确率、稳定性或两者兼优的关键架构与训练因素。为推动领域重视稳定性,项目将公开基准工具包、代码与模型。本工作强调应将时间稳定性与准确性同等纳入核心评估标准,助力更可靠的自动驾驶系统发展。基准资源详见 https://stablehdmap.github.io/。
原文摘要 · Abstract (English)
As one of the fundamental modules in autonomous driving, online high-definition (HD) maps have attracted significant attention due to their cost-effectiveness and real-time capabilities. Since vehicles always cruise in highly dynamic environments, spatial displacement of onboard sensors inevitably causes shifts in real-time HD mapping results, and such instability poses fundamental challenges for downstream tasks. However, existing online map construction models tend to prioritize improving each frame's mapping accuracy, while the mapping stability has not yet been systematically studied. To fill this gap, this paper presents the first comprehensive benchmark for evaluating the temporal stability of online HD mapping models. We propose a multi-dimensional stability evaluation framework with novel metrics for Presence, Localization, and Shape Stability, integrated into a unified mean Average Stability (mAS) score. Extensive experiments on 42 models and variants show that accuracy (mAP) and stability (mAS) represent largely independent performance dimensions. We further analyze the impact of key model design choices on both criteria, identifying architectural and training factors that contribute to high accuracy, high stability, or both. To encourage broader focus on stability, we will release a public benchmark. Our work highlights the importance of treating temporal stability as a core evaluation criterion alongside accuracy, advancing the development of more reliable autonomous driving systems. The benchmark toolkit, code, and models will be available at https://stablehdmap.github.io/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。