提出高效统一的点云地图评估框架,解决SLAM地图质量评价难题
MapEval: Towards Unified, Robust and Efficient SLAM Map Evaluation Framework
- 基于体素化空间的高斯近似沃尔什距离,构建新评估指标
- 比传统方法快100至500倍,且抗噪性强、计算效率高
- 适用于真实与仿真数据,适合机器人与导航研究者使用
在同时定位与地图构建(SLAM)中,对大规模点云地图进行评估仍具挑战性,主要源于缺乏统一、鲁棒且高效的评估框架。本文提出MapEval,一个开源框架,用于全面评估点云地图质量,尤其针对真实地图稀疏而映射环境密集的SLAM场景。通过系统分析现有评估指标的局限性,我们确立了统一的质量评估准则。在此基础上,提出一种体素化空间中的高斯近似沃尔什距离,构建出两个互补指标:体素化平均沃尔什距离(AWD)用于全局几何精度评估,空间一致性评分(SCS)用于局部一致性评估。该理论基础使评估在抗噪声能力和计算效率上显著优于传统方法。在模拟与真实数据集上的大量实验表明,MapEval实现至少100至500倍加速,同时保持评估完整性。MapEval库已公开(https://github.com/JokerJohn/Cloud_Map_Evaluation),旨在推动机器人领域地图评估的标准化实践。
原文摘要 · Abstract (English)
Evaluating massive-scale point cloud maps in Simultaneous Localization and Mapping (SLAM) remains challenging, primarily due to the absence of unified, robust and efficient evaluation frameworks. We present MapEval, an open-source framework for comprehensive quality assessment of point cloud maps, specifically addressing SLAM scenarios where ground truth map is inherently sparse compared to the mapped environment. Through systematic analysis of existing evaluation metrics in SLAM applications, we identify their fundamental limitations and establish clear guidelines for consistent map quality assessment. Building upon these insights, we propose a novel Gaussian-approximated Wasserstein distance in voxelized space, enabling two complementary metrics under the same error standard: Voxelized Average Wasserstein Distance (AWD) for global geometric accuracy and Spatial Consistency Score (SCS) for local consistency evaluation. This theoretical foundation leads to significant improvements in both robustness against noise and computational efficiency compared to conventional metrics. Extensive experiments on both simulated and real-world datasets demonstrate that MapEval achieves at least \SI{100}{}-\SI{500}{} times faster while maintaining evaluation integrity. The MapEval library\footnote{\texttt{https://github.com/JokerJohn/Cloud\_Map\_Evaluation}} will be publicly available to promote standardized map evaluation practices in the robotics community.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。