用边缘像素匹配提升激光雷达与相机融合精度,实时性更强。
EEPNet: Efficient Edge Pixel-based Matching Network for Cross-Modal Dynamic Registration between LiDAR and Camera
- 基于投影点云的反射率图,减少模态差异
- 在视场受限时仍保持高精度,误差低于0.5像素
- 适合自动驾驶实时感知系统部署
多传感器融合对自动驾驶车辆在复杂环境中精准感知、分析和规划轨迹至关重要。这通常涉及激光雷达点云与摄像头图像的数据融合,要求高精度且实时的配准。当前方法在点云与图像配准中因模态差异大、计算开销高而面临挑战。为此,我们提出EEPNet,一种利用点云投影生成的反射率图来提升配准精度的先进网络。点云投影显著降低了网络输入层的跨模态差异,反射率数据则增强了在摄像头视场内点云空间信息有限场景下的性能。此外,通过采用边缘像素进行特征匹配并引入高效匹配优化层,EEPNet大幅加速了实时配准任务。实验验证表明,相比现有最先进方法,EEPNet在准确性和效率上均表现更优。本工作为自动驾驶感知系统提供了重要进展,推动了真实场景下鲁棒高效的传感器融合。
原文摘要 · Abstract (English)
Multisensor fusion is essential for autonomous vehicles to accurately perceive, analyze, and plan their trajectories within complex environments. This typically involves the integration of data from LiDAR sensors and cameras, which necessitates high-precision and real-time registration. Current methods for registering LiDAR point clouds with images face significant challenges due to inherent modality differences and computational overhead. To address these issues, we propose EEPNet, an advanced network that leverages reflectance maps obtained from point cloud projections to enhance registration accuracy. The introduction of point cloud projections substantially mitigates cross-modality differences at the network input level, while the inclusion of reflectance data improves performance in scenarios with limited spatial information of point cloud within the camera's field of view. Furthermore, by employing edge pixels for feature matching and incorporating an efficient matching optimization layer, EEPNet markedly accelerates real-time registration tasks. Experimental validation demonstrates that EEPNet achieves superior accuracy and efficiency compared to state-of-the-art methods. Our contributions offer significant advancements in autonomous perception systems, paving the way for robust and efficient sensor fusion in real-world applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。