arXiv:2502.20676cs.CV2025-02中稿 · Neurocomputing被引 1

提升视觉定位稳定性,利用多层特征融合与批次关联知识增强模型表现

SciceVPR: Stable Cross-Image Correlation Enhanced Model for Visual Place Recognition

  • 通过多层特征融合挖掘DINOv2深层语义信息
  • 利用批次内图像不变相关性提升特征鲁棒性
  • 在东京24/7数据集上召回率提升3%以上,媲美双阶段模型

视觉定位(VPR)是机器人与自主系统的关键挑战,旨在仅基于图像视觉特征预测位置。当前先进模型以DINOv2为骨干提取全局描述符,或探索跨图像关联,或采用耗时的两阶段重排序策略。然而,现有方法仅使用DINOv2最终输出,且跨图像关联导致检索结果不稳定。本文提出稳定的跨图像关联增强模型SciceVPR,充分挖掘DINOv2的多层输出中隐含的上下文知识。首先,通过多层特征融合模块从DINOv2多层输出中捕获更细粒度的空间与通道信息;其次,将批次内图像间的不变关联作为知识,蒸馏至自增强编码器。该设计使模型在光照、天气、视角变化等域偏移下仍能生成稳定且区分性强的全局特征。实验表明,基础版SciceVPR-B在多个数据集上超越现有单输入一阶段模型;大版本SciceVPR-L性能媲美顶级两阶段模型,在挑战性东京24/7数据集上召回率@1高出现有模型超3%。代码将开源于https://github.com/shuimushan/SciceVPR。

原文摘要 · Abstract (English)

Visual Place Recognition (VPR) is a major challenge for robotics and autonomous systems, with the goal of predicting the location of an image based solely on its visual features. State-of-the-art (SOTA) models extract global descriptors using the powerful foundation model DINOv2 as backbone. These models either explore the cross-image correlation or propose a time-consuming two-stage re-ranking strategy to achieve better performance. However, existing works only utilize the final output of DINOv2, and the current cross-image correlation causes unstable retrieval results. To produce both discriminative and constant global descriptors, this paper proposes stable cross-image correlation enhanced model for VPR called SciceVPR. This model explores the full potential of DINOv2 in providing useful feature representations that implicitly encode valuable contextual knowledge. Specifically, SciceVPR first uses a multi-layer feature fusion module to capture increasingly detailed task-relevant channel and spatial information from the multi-layer output of DINOv2. Secondly, SciceVPR considers the invariant correlation between images within a batch as valuable knowledge to be distilled into the proposed self-enhanced encoder. In this way, SciceVPR can acquire fairly robust global features regardless of domain shifts (e.g., changes in illumination, weather and viewpoint between pictures taken in the same place). Experimental results demonstrate that the base variant, SciceVPR-B, outperforms SOTA one-stage methods with single input on multiple datasets with varying domain conditions. The large variant, SciceVPR-L, performs on par with SOTA two-stage models, scoring over 3% higher in Recall@1 compared to existing models on the challenging Tokyo24/7 dataset. Our code will be released at https://github.com/shuimushan/SciceVPR.

视觉定位DINOv2特征融合鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。