用事件相机在激光地图中实现高精度定位,解决极端光照下的导航难题。
EVLoc: Event-based Visual Localization in LiDAR Maps via Event-Depth Registration
- 通过事件-深度配准,将事件数据与激光点云对齐进行姿态估计
- 在多个公开数据集上实现亚米级定位精度,优于现有方法
- 适合需要高速、低延迟感知的机器人导航场景
事件相机具有高动态范围和低延迟等生物启发特性,特别适用于高速运动和极端光照条件下的感知。本文探索其在预构建激光地图中进行定位的潜力,这是实现精准导航与移动操作的关键任务。所提框架基于初始位姿的优化:首先根据粗略初始位姿将激光点投影至二维空间生成深度图,再利用光流网络在二维空间对齐事件与激光点,最后通过PnP求解器估计相机位姿。为增强两种模态间的几何一致性,提出一种新型基于帧的事件表示,提升结构清晰度。此外,针对真实位姿存在不同程度偏差的问题,设计一个辅助变量预测模块作为正则项,缓解偏差对网络收敛的影响。在多个公开数据集上的实验结果证明了方法的有效性。为促进后续研究,代码与预训练模型已开源。
原文摘要 · Abstract (English)
Event cameras are bio-inspired sensors with some notable features, including high dynamic range and low latency, which makes them exceptionally suitable for perception in challenging scenarios such as high-speed motion and extreme lighting conditions. In this paper, we explore their potential for localization within pre-existing LiDAR maps, a critical task for applications that require precise navigation and mobile manipulation. Our framework follows a paradigm based on the refinement of an initial pose. Specifically, we first project LiDAR points into 2D space based on a rough initial pose to obtain depth maps, and then employ an optical flow estimation network to align events with LiDAR points in 2D space, followed by camera pose estimation using a PnP solver. To enhance geometric consistency between these two inherently different modalities, we develop a novel frame-based event representation that improves structural clarity. Additionally, given the varying degrees of bias observed in the ground truth poses, we design a module that predicts an auxiliary variable as a regularization term to mitigate the impact of this bias on network convergence. Experimental results on several public datasets demonstrate the effectiveness of our proposed method. To facilitate future research, both the code and the pre-trained models are made available online.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。