融合卷积与视觉变压器,提升环境变化下的定位精度
Feature Complementation Architecture for Visual Place Recognition
- 并行使用CNN和ViT提取局部与全局特征
- 动态融合模块提升特征表达能力,准确率显著提高
- 轻量适配器让模型快速适应新场景,适合实际部署
视觉场景识别(VPR)在机器人定位与导航中至关重要。核心挑战在于构建对环境变化鲁棒的特征表示。现有方法通常采用卷积神经网络(CNN)或视觉变换器(ViT)作为特征提取器。然而,两者各有优势——CNN擅长捕捉局部细节,而ViT更善于建模全局上下文,难以兼顾。为此,我们提出一种用于VPR的局部-全局特征互补网络(LGCN),其采用并行的CNN-ViT混合架构,并引入动态特征融合模块(DFM),通过联合建模空间与通道依赖关系实现动态融合。此外,为增强冻结的ViT主干对VPR任务的表达力与适应性,我们在其中加入轻量级频域-空间融合适配器,以极小参数开销实现任务特异性调整。在多个VPR基准数据集上的大量实验表明,所提LGCN在定位精度与鲁棒性方面持续优于现有方法,验证了其有效性和泛化能力。
原文摘要 · Abstract (English)
Visual place recognition (VPR) plays a crucial role in robotic localization and navigation. The key challenge lies in constructing feature representations that are robust to environmental changes. Existing methods typically adopt convolutional neural networks (CNNs) or vision Transformers (ViTs) as feature extractors. However, these architectures excel in different aspects -- CNNs are effective at capturing local details. At the same time, ViTs are better suited for modeling global context, making it difficult to leverage the strengths of both. To address this issue, we propose a local-global feature complementation network (LGCN) for VPR which integrates a parallel CNN-ViT hybrid architecture with a dynamic feature fusion module (DFM). The DFM performs dynamic feature fusion through joint modeling of spatial and channel-wise dependencies. Furthermore, to enhance the expressiveness and adaptability of the ViT branch for VPR tasks, we introduce lightweight frequency-to-spatial fusion adapters into the frozen ViT backbone. These adapters enable task-specific adaptation with controlled parameter overhead. Extensive experiments on multiple VPR benchmark datasets demonstrate that the proposed LGCN consistently outperforms existing approaches in terms of localization accuracy and robustness, validating its effectiveness and generalizability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。