构建大规模真实场景跨传感器点云数据集,提升不同设备间点云配准精度。
Cross3DReg: Towards a Large-scale Real-world Cross-source Point Cloud Registration Benchmark
- 基于图像与几何信息融合的注意力匹配模块,增强跨源特征一致性。
- 在跨源点云配准中降低63.2%相对旋转误差和40.2%平移误差。
- 适用于自动驾驶、机器人等需多传感器协同的三维感知场景。
跨源点云配准旨在对不同传感器采集的点云进行对齐,是三维视觉的基础任务。然而,相比同源配准,其面临两大挑战:缺乏大规模真实世界训练数据,以及多传感器带来的固有差异。传感器导致的多样模式增加了鲁棒且精确特征提取与匹配的难度,影响配准精度。为此,我们构建了目前最大规模的真实世界多模态跨源点云配准数据集Cross3DReg,由旋转式机械激光雷达与混合半固态激光雷达分别采集。此外,设计了一种基于重叠区域预测的跨源配准框架,利用未对齐图像预测源与目标点云间的重叠区域,有效剔除非重叠区冗余点,显著缓解非重叠区域噪声干扰。进一步提出视觉-几何注意力引导匹配模块,融合图像与几何信息以建立可靠对应关系,实现高精度、鲁棒的配准。大量实验表明,该方法达到最先进性能:相对旋转误差(RRE)降低63.2%,相对平移误差(RTE)降低40.2%,注册召回率(RR)提升5.4%,验证了其有效性。
原文摘要 · Abstract (English)
Cross-source point cloud registration, which aims to align point cloud data from different sensors, is a fundamental task in 3D vision. However, compared to the same-source point cloud registration, cross-source registration faces two core challenges: the lack of publicly available large-scale real-world datasets for training the deep registration models, and the inherent differences in point clouds captured by multiple sensors. The diverse patterns induced by the sensors pose great challenges in robust and accurate point cloud feature extraction and matching, which negatively influence the registration accuracy. To advance research in this field, we construct Cross3DReg, the currently largest and real-world multi-modal cross-source point cloud registration dataset, which is collected by a rotating mechanical lidar and a hybrid semi-solid-state lidar, respectively. Moreover, we design an overlap-based cross-source registration framework, which utilizes unaligned images to predict the overlapping region between source and target point clouds, effectively filtering out redundant points in the irrelevant regions and significantly mitigating the interference caused by noise in non-overlapping areas. Then, a visual-geometric attention guided matching module is proposed to enhance the consistency of cross-source point cloud features by fusing image and geometric information to establish reliable correspondences and ultimately achieve accurate and robust registration. Extensive experiments show that our method achieves state-of-the-art registration performance. Our framework reduces the relative rotation error (RRE) and relative translation error (RTE) by $63.2\%$ and $40.2\%$, respectively, and improves the registration recall (RR) by $5.4\%$, which validates its effectiveness in achieving accurate cross-source registration.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。