arXiv:2502.19374cs.RO2025-02被引 5

用视觉模型特征做激光雷达配准,跨季节也能准。

LiDAR Registration with Visual Foundation Models

  • 用DINOv2图像特征当点云描述子
  • 在NCLT和Oxford RobotCar上召回率提升24.8%和17.3%
  • 无需重训练,适配稀疏与密集点云

激光雷达配准是机器人建图与定位的基础任务。对齐两组点云的关键在于使用点描述子识别鲁棒对应点。但在领域偏移、季节变化和点云结构差异下,手工设计和学习型方法均面临挑战。本文提出利用环绕视角图像的DINOv2特征作为点描述子,结合RANSAC或ICP等传统算法,实现即使地图记录超过一年仍能稳健进行6自由度配准。该方法虽概念简单,但显著优于复杂基线模型。相比以往学习型描述子,本方法无需领域特定微调,且对点云结构无感,可有效处理稀疏激光扫描与稠密三维地图。实验表明,借助额外摄像头数据,本方法在NCLT和Oxford RobotCar数据集上的注册召回率分别领先基线+24.8%和+17.3%。代码与基准测试已公开于https://vfm-registration.cs.uni-freiburg.de。

原文摘要 · Abstract (English)

LiDAR registration is a fundamental task in robotic mapping and localization. A critical component of aligning two point clouds is identifying robust point correspondences using point descriptors. This step becomes particularly challenging in scenarios involving domain shifts, seasonal changes, and variations in point cloud structures. These factors substantially impact both handcrafted and learning-based approaches. In this paper, we address these problems by proposing to use DINOv2 features, obtained from surround-view images, as point descriptors. We demonstrate that coupling these descriptors with traditional registration algorithms, such as RANSAC or ICP, facilitates robust 6DoF alignment of LiDAR scans with 3D maps, even when the map was recorded more than a year before. Although conceptually straightforward, our method substantially outperforms more complex baseline techniques. In contrast to previous learning-based point descriptors, our method does not require domain-specific retraining and is agnostic to the point cloud structure, effectively handling both sparse LiDAR scans and dense 3D maps. We show that leveraging the additional camera data enables our method to outperform the best baseline by +24.8 and +17.3 registration recall on the NCLT and Oxford RobotCar datasets. We publicly release the registration benchmark and the code of our work on https://vfm-registration.cs.uni-freiburg.de.

激光雷达视觉融合点云配准DINOv2

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。