提出融合光照引导与多模态数据的视觉里程计,显著提升暗光环境下的定位精度。
BRIGHT-VO: Brightness-Guided Hybrid Transformer for Visual Odometry with Multi-modality Refinement Module
- 基于Transformer架构,结合光照特征与IMU数据进行联合优化
- 在低光条件下定位精度提升259%,正常环境提升20%
- 开源代码与自建低光数据集KiC4R,适合自动驾驶与机器人研发
视觉里程计(VO)在自动驾驶、机器人导航等任务中通过视觉输入估计相机位姿。尽管数据驱动的深度学习方法已取得进展,但在低光环境下因特征可见性降低和关键点匹配困难而表现不佳。为此,本文提出BrightVO,一种基于Transformer的新型VO模型,不仅实现前端视觉特征提取,还在后端引入多模态融合模块,整合惯性测量单元(IMU)数据,并通过位姿图优化迭代修正位姿估计,提升准确性和鲁棒性。此外,构建了合成低光数据集KiC4R,涵盖多种光照条件,用于训练和评估复杂环境下的VO系统。实验表明,BrightVO在KiC4R和KITTI基准上均达到领先性能:正常户外环境下平均精度提升20%,低光条件下提升259%。相关代码与数据集已开源。
原文摘要 · Abstract (English)
Visual odometry (VO) plays a crucial role in autonomous driving, robotic navigation, and other related tasks by estimating the position and orientation of a camera based on visual input. Significant progress has been made in data-driven VO methods, particularly those leveraging deep learning techniques to extract image features and estimate camera poses. However, these methods often struggle in low-light conditions because of the reduced visibility of features and the increased difficulty of matching keypoints. To address this limitation, we introduce BrightVO, a novel VO model based on Transformer architecture, which not only performs front-end visual feature extraction, but also incorporates a multi-modality refinement module in the back-end that integrates Inertial Measurement Unit (IMU) data. Using pose graph optimization, this module iteratively refines pose estimates to reduce errors and improve both accuracy and robustness. Furthermore, we create a synthetic low-light dataset, KiC4R, which includes a variety of lighting conditions to facilitate the training and evaluation of VO frameworks in challenging environments. Experimental results demonstrate that BrightVO achieves state-of-the-art performance on both the KiC4R dataset and the KITTI benchmarks. Specifically, it provides an average improvement of 20% in pose estimation accuracy in normal outdoor environments and 259% in low-light conditions, outperforming existing methods. For widespread use and further development, the research work is fully open-source at https://github.com/Anastasiawd/BrightVO.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。