利用街灯作为导航参照,让低成本摄像头在夜间精准定位。
Night-Voyager: Consistent and Efficient Nocturnal Vision-Aided State Estimation in Object Maps
- 用物体地图和关键点实现夜间视觉定位,避开像素级误差
- 实测覆盖12.3公里,全局状态估计一致且高效
- 适合城市夜间自动驾驶、机器人导航等场景
夜间精准可靠的位姿估计对自主机器人完成夜行或全天候任务至关重要。一个关键问题是:能否利用低成本普通摄像头实现夜间定位?现有视觉方法在恶劣光照下常失效,即使使用主动光源或图像增强亦然。重要洞察是:多数城市环境中街灯可作为稳定显著的先验视觉线索,如同深空中的星辰辅助航天器导航。受此启发,我们提出 Night-Voyager,一种基于物体级先验地图与关键点的夜间视觉辅助位姿估计框架。发现传统方法在弱光下失效主因在于依赖像素级度量;而无度量、非像素级的物体检测可衔接像素与物体空间,有效传递利用地图信息。Night-Voyager 首先通过快速初始化解决全局定位问题,再借助两阶段跨模态数据关联,实现基于地图观测的全局一致状态更新。为应对夜间视觉观测不确定性,引入新颖的矩阵李群形式化与特征解耦多状态不变滤波器,保障估计的一致性与效率。在仿真及多种真实场景(累计约12.3公里)中全面实验验证其有效性、鲁棒性与高效性,填补了夜间视觉辅助位姿估计的关键空白。
原文摘要 · Abstract (English)
Accurate and robust state estimation at nighttime is essential for autonomous robotic navigation to achieve nocturnal or round-the-clock tasks. An intuitive question arises: Can low-cost standard cameras be exploited for nocturnal state estimation? Regrettably, most existing visual methods may fail under adverse illumination conditions, even with active lighting or image enhancement. A pivotal insight, however, is that streetlights in most urban scenarios act as stable and salient prior visual cues at night, reminiscent of stars in deep space aiding spacecraft voyage in interstellar navigation. Inspired by this, we propose Night-Voyager, an object-level nocturnal vision-aided state estimation framework that leverages prior object maps and keypoints for versatile localization. We also find that the primary limitation of conventional visual methods under poor lighting conditions stems from the reliance on pixel-level metrics. In contrast, metric-agnostic, non-pixel-level object detection serves as a bridge between pixel-level and object-level spaces, enabling effective propagation and utilization of object map information within the system. Night-Voyager begins with a fast initialization to solve the global localization problem. By employing an effective two-stage cross-modal data association, the system delivers globally consistent state updates using map-based observations. To address the challenge of significant uncertainties in visual observations at night, a novel matrix Lie group formulation and a feature-decoupled multi-state invariant filter are introduced, ensuring consistent and efficient estimation. Through comprehensive experiments in both simulation and diverse real-world scenarios (spanning approximately 12.3 km), Night-Voyager showcases its efficacy, robustness, and efficiency, filling a critical gap in nocturnal vision-aided state estimation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。