让视觉与惯性传感器自主评估可靠性,提升复杂环境下的定位精度。
MAC-I$^2$: Learned Metrics-Aware Covariance for Robust Visual-Inertial Fusion in Initialization and Calibration

- 用学习的度量感知协方差替代固定不确定性,使视觉与惯性数据公平竞争。
- 在EuRoC上实现99.9%初始化成功率,重力和速度误差降低60%与42%。
- 适合需要高鲁棒性的机器人导航与自动驾驶系统使用。
视觉-惯性(VI)融合是实现精准鲁棒状态估计的基础,需根据相机与惯性测量单元(IMU)各自的不确定性进行融合。现有方法采用预设的不确定性,忽略局部环境中的实际可靠性,导致在光照变化、动态物体和无纹理区域等挑战场景下表现不佳。本文提出MAC-I²,通过学习的度量感知协方差实现视觉与惯性融合的鲁棒性提升,使两类模态基于自身真实性能竞争,而非依赖固定参数。视觉端将学习到的特征匹配不确定性传播至位姿协方差;惯性端则基于积分误差早期快速累积、后期缓慢增长的特性,设计可学习初始协方差的IMU模型,并在保留训练子集上采用专用微调策略,实现对未见序列的度量感知协方差。以视觉-惯性初始化与标定系统为例,实验表明:在EuRoC数据集上,初始化成功率高达99.9%,重力与速度误差相比最强基线分别降低约60%和42%;在具有挑战性的VBR序列上仍保持80%成功率,而基线方法如VINS-Mono下降至10%以下。
原文摘要 · Abstract (English)
Visual-Inertial (VI) fusion is fundamental to accurate and robust state estimation, where camera and IMU measurements are combined according to their respective uncertainties. Existing methods, however, fuse the two modalities with predefined uncertainties, regardless of how reliable each is in the local context, and thus often struggle under challenging environments involving illumination changes, dynamic objects, and textureless regions. In this paper, we present MAC-I$^2$, which achieves robust VI fusion through learned metric-aware covariance for both modalities, so that vision and IMU compete on their own merits rather than relying on predefined uncertainties. Here, metrics-aware means that each predicted covariance faithfully reflects the actual magnitude of the corresponding measurement noise. On the visual side, we propagate learned feature-matching uncertainties into pose covariances for the fusion. On the inertial side, motivated by the observation that integration error accumulates sharply at the early stage and grows slowly afterward, we design a learned IMU model with a learnable initial covariance, and propose a dedicated fine-tuning strategy on a held-out training subset to enable the metrics-aware covariance on unseen sequences. As a showcase, we build a VI initialization and calibration system, since accurate and robust initialization and calibration are the prerequisite for any reliable VI system. Experiments on EuRoC, and VBR show that MAC-I$^2$ substantially outperforms existing methods: it achieves a 99.9% initialization success rate on EuRoC, reducing gravity and velocity errors by about 60% and 42% over the strongest baseline, and maintains 80% success rate on challenging VBR sequences where baseline methods such as VINS-Mono drop below 10%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。