提出在线自适应方法,让视觉里程计在新环境中快速保持精准深度与位姿估计。
An Online Adaptation Method for Robust Depth Estimation and Visual Odometry in the Open World
- 用轻量级精修模块实现单目深度网络的在线高效更新。
- 结合相机位姿与场景语义生成伪深度图和有效掩码,支持自监督学习。
- 在城市、室内场景及机器人平台验证,显著提升开放世界泛化能力。
近年来,基于学习的机器人导航系统受到广泛关注并取得显著进展。然而,开放世界场景的多样性给这类系统的泛化能力带来重大挑战:当应用场景偏离训练数据时,场景度量与状态估计性能会下降,导致深度和位姿估计不可靠。为解决此问题,本文提出一种可在线快速适应多样新环境的视觉里程计系统。构建了一个自监督的在线适应框架,融合在线更新的深度估计模块。首先设计了一个带有轻量级精修模块的单目深度估计网络,支持高效在线适应;其次,基于视觉里程计输出和场景上下文语义信息,构建自监督学习目标。具体地,提出稀疏深度补全模块与动态一致性增强模块,利用相机位姿与上下文语义生成伪深度图和有效掩码,用于在线适应。最后,在城市、室内数据集及机器人平台上,对比现有先进方法验证了所提方法的鲁棒性与泛化能力。代码已公开于:https://github.com/jixingwu/SOL-SLAM。
原文摘要 · Abstract (English)
Recently, learning-based robotic navigation systems have gained extensive research attention and made significant progress. However, the diversity of open-world scenarios poses a major challenge for the generalization of such systems to practical scenarios. Specifically, learned systems for scene measurement and state estimation tend to degrade when the application scenarios deviate from the training data, resulting to unreliable depth and pose estimation. Toward addressing this problem, this work aims to develop a visual odometry system that can fast adapt to diverse novel environments in an online manner. To this end, we construct a self-supervised online adaptation framework for monocular visual odometry aided by an online-updated depth estimation module. Firstly, we design a monocular depth estimation network with lightweight refiner modules, which enables efficient online adaptation. Then, we construct an objective for self-supervised learning of the depth estimation module based on the output of the visual odometry system and the contextual semantic information of the scene. Specifically, a sparse depth densification module and a dynamic consistency enhancement module are proposed to leverage camera poses and contextual semantics to generate pseudo-depths and valid masks for the online adaptation. Finally, we demonstrate the robustness and generalization capability of the proposed method in comparison with state-of-the-art learning-based approaches on urban, in-house datasets and a robot platform. Code is publicly available at: https://github.com/jixingwu/SOL-SLAM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。