提出双尺度交叉学习Transformer,提升视觉定位在不同视角下的鲁棒性。
DSFormer: A Dual-Scale Cross-Learning Transformer for Visual Place Recognition
- 用双尺度特征双向交互增强视觉表征
- 在多个数据集上超越现有方法,且训练数据量减少30%
- 适合需要高效高鲁棒性的机器人定位场景
视觉定位(VPR)对移动机器人可靠定位至关重要,但受环境变化和视角差异影响大。本文提出基于Transformer的双尺度交叉学习模块DSFormer,通过提取最后两层CNN的双尺度特征,利用自注意力捕获尺度内长程依赖,并通过共享交叉注意力实现跨尺度学习,增强语义与空间细节表达。同时设计块聚类策略,从多视角重构广泛使用的旧金山超大规模(SF-XL)训练数据集,优化数据组织以提升视角不变性。两者结合使模型生成适应环境变化的鲁棒全局嵌入,相比以往划分方法减少约30%训练数据量。大量实验表明,该方法在多数基准数据集上达到当前最优性能,作为512维全局描述符的全局检索方案,优于DELG、Patch-NetVLAD、TransVPR和R2Former等先进重排序方法,且显著提升计算效率。
原文摘要 · Abstract (English)
Visual Place Recognition (VPR) is crucial for robust mobile robot localization, yet it faces significant challenges in maintaining reliable performance under varying environmental conditions and viewpoints. To address this, we propose a novel framework that integrates Dual-Scale-Former (DSFormer), a Transformer-based cross-learning module, with an innovative block clustering strategy. DSFormer enhances feature representation by enabling bidirectional information transfer between dual-scale features extracted from the final two CNN layers, capturing both semantic richness and spatial details through self-attention for long-range dependencies within each scale and shared cross-attention for cross-scale learning. Complementing this, our block clustering strategy repartitions the widely used San Francisco eXtra Large (SF-XL) training dataset from multiple distinct perspectives, optimizing data organization to further bolster robustness against viewpoint variations. Together, these innovations not only yield a robust global embedding adaptable to environmental changes but also reduce the required training data volume by approximately 30\% compared to previous partitioning methods. Comprehensive experiments demonstrate that our approach achieves state-of-the-art performance across most benchmark datasets, surpassing advanced reranking methods like DELG, Patch-NetVLAD, TransVPR, and R2Former as a global retrieval solution using 512-dim global descriptors, while significantly improving computational efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。