用可学习的不确定性优化立体视觉里程计,提升复杂环境下的定位可靠性
MAC-VO: Metrics-aware Covariance for Learning-based Stereo Visual Odometry
- 基于学习到的匹配不确定性筛选高质量特征点
- 设计度量感知协方差模型,捕捉注册误差与轴间相关性
- 在光照变化等挑战场景中优于主流VO与部分SLAM方法
我们提出MAC-VO,一种新型基于学习的立体视觉里程计(VO),利用学习到的度量感知匹配不确定性实现双重目的:选择关键点并加权姿态图优化中的残差。不同于传统几何方法优先选取纹理丰富的边缘特征,我们的关键点选择器通过全局不一致性学习来过滤低质量特征。与现有学习算法中建模尺度无关的对角权重矩阵不同,我们设计了度量感知协方差模型,以捕捉关键点配准过程中的空间误差及各轴间的相关性。将该协方差模型融入姿态图优化,显著提升了姿态估计的鲁棒性与可靠性,尤其在光照变化、特征密度差异和运动模式多变的挑战性环境中表现优异。在公开基准数据集上,MAC-VO超越现有VO算法,甚至在部分场景下优于某些SLAM算法。此外,协方差图还提供了估计姿态可靠性的有价值信息,有助于自主系统决策。
原文摘要 · Abstract (English)
We propose the MAC-VO, a novel learning-based stereo VO that leverages the learned metrics-aware matching uncertainty for dual purposes: selecting keypoint and weighing the residual in pose graph optimization. Compared to traditional geometric methods prioritizing texture-affluent features like edges, our keypoint selector employs the learned uncertainty to filter out the low-quality features based on global inconsistency. In contrast to the learning-based algorithms that model the scale-agnostic diagonal weight matrix for covariance, we design a metrics-aware covariance model to capture the spatial error during keypoint registration and the correlations between different axes. Integrating this covariance model into pose graph optimization enhances the robustness and reliability of pose estimation, particularly in challenging environments with varying illumination, feature density, and motion patterns. On public benchmark datasets, MAC-VO outperforms existing VO algorithms and even some SLAM algorithms in challenging environments. The covariance map also provides valuable information about the reliability of the estimated poses, which can benefit decision-making for autonomous systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。