用视觉几何大模型实现免标定千米级定位,解决长期漂移问题。
Keep It CALM: Toward Calibration-Free Kilometer-Level SLAM with Visual Geometry Foundation Models via an Assistant Eye

- 引入‘助理眼’利用恒定物理间距先验,消除尺度模糊
- 通过基础矩阵分解在线修正内参误差,减少旋转平移偏差
- 基于锚点传播的全局一致映射,支持非线性子图对齐
视觉几何基础模型(VGFMs)在局部重建中展现出卓越的零样本能力。然而,将其用于千米级同时定位与地图构建(SLAM)仍面临挑战。现有方法主要依赖线性变换(如Sim3和SL4)进行子图对齐,但单一线性变换无法建模VGFM输出中的复杂非线性几何畸变,导致未校正残差快速累积,最终引发显著轨迹漂移与地图发散。为此,我们提出CAL2M(免标定辅助眼大尺度定位与建图)框架,可兼容任意VGFMs。不同于传统系统,CAL2M引入“助理眼”仅利用恒定物理间距先验,无需时空预标定即可消除尺度模糊。此外,在准确特征匹配假设下,提出基于对极约束的内参与位姿校正模型,并结合在线内参搜索模块,通过基础矩阵分解有效纠正因内参不准引起的旋转与平移误差。最后,为确保高精度映射,提出基于锚点传播的全局一致性映射策略:通过跨轨迹构建与融合锚点,建立局部到全局的直接映射关系,使非线性变换得以弹性对齐子图,彻底消除几何错位,保障全局一致性重建。项目代码将公开于https://github.com/IRMVLab/CALM。
原文摘要 · Abstract (English)
Visual Geometry Foundation Models (VGFMs) demonstrate remarkable zero-shot capabilities in local reconstruction. However, deploying them for kilometer-level Simultaneous Localization and Mapping (SLAM) remains challenging. In such scenarios, current approaches mainly rely on linear transforms (e.g., Sim3 and SL4) for sub-map alignment, while we argue that a single linear transform is fundamentally insufficient to model the complex, non-linear geometric distortions inherent in VGFM outputs. Forcing such rigid alignment leads to the rapid accumulation of uncorrected residuals, eventually resulting in significant trajectory drift and map divergence. To address these limitations, we present CAL2M (Calibration-free Assistant-eye based Large-scale Localization and Mapping), a plug-and-play framework compatible with arbitrary VGFMs. Distinct from traditional systems, CAL2M introduces an "assistant eye" solely to leverage the prior of constant physical spacing, effectively eliminating scale ambiguity without any temporal or spatial pre-calibration. Furthermore, leveraging the assumption of accurate feature matching, we propose an epipolar-guided intrinsic and pose correction model. Supported by an online intrinsic search module, it can effectively rectify rotation and translation errors caused by inaccurate intrinsics through fundamental matrix decomposition. Finally, to ensure accurate mapping, we introduce a globally consistent mapping strategy based on anchor propagation. By constructing and fusing anchors across the trajectory, we establish a direct local-to-global mapping relationship. This enables the application of nonlinear transformations to elastically align sub-maps, effectively eliminating geometric misalignments and ensuring a globally consistent reconstruction. The source code of CAL2M will be publicly available at https://github.com/IRMVLab/CALM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。