arXiv:2606.01734cs.CVcs.LG2026-06

让视觉定位特征更平直,提升稀疏地图下的定位精度

FlatVPR: Plug-and-play Geo-linear Residual Adapter for Geometric Rectification of Foundation Model Feature Manifolds

论文配图:FlatVPR: Plug-and-play Geo-linear Residual Adapter for Geometric Rectification of Foundation Model Feature Manifolds
图 1 · 摘自论文原文
  • 用可学习适配器对基础模型特征做残差修正,实现线性插值重建
  • 在100米间隔稀疏锚点下仍保持高精度,跨季节变化鲁棒
  • 适合需要轻量化地图的自动驾驶与机器人定位场景

本文提出一种名为FlatVPR的新几何校正范式,通过强制构建特征流形结构,使任意相邻锚点间描述子可通过线性插值准确重构。尽管DINOv2-ViT-S/14等先进基础模型提供鲁棒语义特征,其潜在流形存在显著曲率,导致物理空间中的匀速运动在特征空间中表现为高度非线性轨迹,影响稀疏锚点下的可靠重建。为此,我们引入残差变换$\ ext{Res}(\f{z})$,对原始特征$\f{z}$进行调整,并设计基于数学原理的拉回平坦损失(Pullback Flatness Loss),最小化中间特征偏离相邻锚点连线的偏差,从而降低流形内在曲率。通过该空间扁平化处理,地图构建被置于期望-最大化(EM)框架中,解耦为连续的M步(流形适配)与概念性的E步(最优锚点选择指导)。在NCLT数据集上的实验表明,即使在100米间隔和极端季节变化条件下,该适配器仍带来显著性能提升。

原文摘要 · Abstract (English)

This paper proposes ``FlatVPR,'' a novel geometric rectification paradigm that effectively bridges the trade-off between map lightweightness and localization accuracy in visual place recognition (VPR) by enforcing a feature manifold structure where any descriptor between two adjacent anchors $\mathbf{z}_A$ and $\mathbf{z}_B$ can be accurately reconstructed via linear interpolation $\hat{\mathbf{z}}_{pseudo} = (1-t)\mathbf{z}_A + t\mathbf{z}_B$, where $t \in [0,1]$ denotes the relative position. While state-of-the-art foundation models such as DINOv2-ViT-S/14 provide robust semantic features, their latent manifolds exhibit prominent curvature, projecting uniform linear motion in physical space onto highly non-linear trajectories in the feature space, which hinders reliable reconstruction under sparse anchor conditions. To enable the aforementioned interpolation-based reconstruction, we introduce a residual transformation $\hat{\mathbf{z}} = \mathbf{z} + \text{Res}(\mathbf{z})$ to the raw foundation features $\mathbf{z}$, where $\text{Res}(\cdot)$ represents a learnable adapter. Our method explicitly suppresses manifold curvature using a mathematically grounded Pullback Flatness Loss that minimizes the deviation of intermediate features from the linear segment connecting adjacent anchors, thereby minimizing the intrinsic curvature of the manifold. Through this spatial flattening, map construction is formulated within an Expectation-Maximization (EM) framework, decoupled into a continuous M-step for manifold adaptation and a conceptual E-step for optimal anchor selection guidelines. Experiments on the NCLT dataset demonstrate that the application of our adapter leads to significant performance improvements even under extremely sparse anchor conditions with 100m intervals and extreme seasonal changes.

视觉定位特征流形适配器地图构建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。