用边缘特征提升图像与点云配准精度,兼顾效率与鲁棒性。
EdgeRegNet: Edge Feature-based Multimodal Registration Network between Images and LiDAR Point Clouds
- 基于原始数据的边缘点与边缘像素进行跨模态匹配。
- 在KITTI和nuScenes上达到当前最优性能,提升配准精度。
- 适合自动驾驶中多传感器融合场景,对计算资源友好。
跨模态数据配准是计算机视觉中的关键任务,广泛应用于自动驾驶与机器人领域。准确可靠的配准方法对于对齐不同模态的数据至关重要,是实现多传感器数据融合、提升感知系统精度与可靠性的基础。图像与激光雷达点云之间的配准通常被视为视觉位姿估计问题:利用不同模态的高维特征相似性识别像素-点对应关系,并通过最小二乘法进行位姿估计。然而,现有方法常因计算限制对原始数据进行下采样,导致精度损失;且不同模态提取的高维特征需专门技术以缓解跨模态差异,影响匹配效果。为此,本文提出一种基于边缘特征的跨模态配准方法:保留原始点云与图像中的边缘点与边缘像素,有效捕捉关键结构信息,同时引入注意力机制的特征交换模块消除跨模态差异,并设计最优匹配层增强对应关系识别。我们在KITTI与nuScenes数据集上验证了该方法的准确性,结果表明其性能达到当前最优水平。
原文摘要 · Abstract (English)
Cross-modal data registration has long been a critical task in computer vision, with extensive applications in autonomous driving and robotics. Accurate and robust registration methods are essential for aligning data from different modalities, forming the foundation for multimodal sensor data fusion and enhancing perception systems' accuracy and reliability. The registration task between 2D images captured by cameras and 3D point clouds captured by Light Detection and Ranging (LiDAR) sensors is usually treated as a visual pose estimation problem. High-dimensional feature similarities from different modalities are leveraged to identify pixel-point correspondences, followed by pose estimation techniques using least squares methods. However, existing approaches often resort to downsampling the original point cloud and image data due to computational constraints, inevitably leading to a loss in precision. Additionally, high-dimensional features extracted using different feature extractors from various modalities require specific techniques to mitigate cross-modal differences for effective matching. To address these challenges, we propose a method that uses edge information from the original point clouds and images for cross-modal registration. We retain crucial information from the original data by extracting edge points and pixels, enhancing registration accuracy while maintaining computational efficiency. The use of edge points and edge pixels allows us to introduce an attention-based feature exchange block to eliminate cross-modal disparities. Furthermore, we incorporate an optimal matching layer to improve correspondence identification. We validate the accuracy of our method on the KITTI and nuScenes datasets, demonstrating its state-of-the-art performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。