arXiv:2412.20082cs.CV2024-12CVPR被引 14

用Mamba结构优化视觉里程计匹配,提升定位精度与稳定性。

MambaVO: Deep Visual Odometry Based on Sequential Matching Refinement and Training Smoothing

  • 基于点帧图的几何初始化+Mamba模块逐帧优化匹配
  • 在公开数据集上达到最优性能且实时运行
  • 适合需要高鲁棒性的自动驾驶与机器人定位场景

深度视觉里程计通过学习优化技术取得显著进展,但依赖帧间视觉匹配,在复杂场景中模糊匹配会导致几何建模和束调整误差,降低位姿估计精度与鲁棒性。本文提出MambaVO,通过鲁棒初始化、基于Mamba的序列匹配精化及训练平滑来提升匹配质量。新帧通过半稠密几何初始化模块(GIM)与维护的点帧图(PFG)中最邻近关键帧匹配;随后,提出的几何Mamba模块(GMM)利用匹配特征精化帧间匹配;最终通过可微束调整(differentiable BA)优化位姿与地图。为缓解梯度方差,设计趋势感知惩罚(TAP)以平滑训练,提升收敛性与稳定性。最后引入回环检测模块形成MambaVO++。在多个公开基准测试中,MambaVO与MambaVO++均实现当前最优表现,并保证实时运行。

原文摘要 · Abstract (English)

Deep visual odometry has demonstrated great advancements by learning-to-optimize technology. This approach heavily relies on the visual matching across frames. However, ambiguous matching in challenging scenarios leads to significant errors in geometric modeling and bundle adjustment optimization, which undermines the accuracy and robustness of pose estimation. To address this challenge, this paper proposes MambaVO, which conducts robust initialization, Mamba-based sequential matching refinement, and smoothed training to enhance the matching quality and improve the pose estimation. Specifically, the new frame is matched with the closest keyframe in the maintained Point-Frame Graph (PFG) via the semi-dense based Geometric Initialization Module (GIM). Then the initialized PFG is processed by a proposed Geometric Mamba Module (GMM), which exploits the matching features to refine the overall inter-frame matching. The refined PFG is finally processed by differentiable BA to optimize the poses and the map. To deal with the gradient variance, a Trending-Aware Penalty (TAP) is proposed to smooth training and enhance convergence and stability. A loop closure module is finally applied to enable MambaVO++. On public benchmarks, MambaVO and MambaVO++ demonstrate SOTA performance, while ensuring real-time running.

视觉里程计Mamba位姿估计端到端

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。