聚焦图像中关键局部区域,提升视觉定位准确率与效率。
Focus on Local: Finding Reliable Discriminative Regions for Visual Place Recognition
- 通过双损失机制精准挖掘可靠局部特征。
- 在多个基准上达到当前最佳检索与重排序性能。
- 适合追求高精度与低延迟的视觉定位应用。
视觉定位(VPR)旨在通过参考带有地理标签的图像数据库,预测查询图像的位置。通常,图像中少数具有区分性的局部区域起关键作用,而普通背景区域不仅无贡献,还可能因重叠导致误判。现有方法未能精确建模并充分挖掘这些区分性区域。本文提出聚焦局部(FoL)方法,通过挖掘和利用可靠的区分性局部区域,并引入伪相关性监督,同时提升图像检索与重排序性能。首先,设计两种损失函数:提取-聚合空间对齐损失(SAL)与前景-背景对比增强损失(CEL),显式建模区分性局部区域,指导全局表示生成与高效重排序。其次,基于全局特征聚合获得的伪对应关系,提出弱监督局部特征训练策略,缓解VPR任务中局部对应真值缺失问题。第三,设计基于区分性区域引导的高效重排序流水线。实验表明,FoL在多个VPR基准上均实现当前最优的检索与重排序表现,且显著优于现有两阶段VPR方法的计算效率。代码与模型已开源于https://github.com/chenshunpeng/FoL。
原文摘要 · Abstract (English)
Visual Place Recognition (VPR) is aimed at predicting the location of a query image by referencing a database of geotagged images. For VPR task, often fewer discriminative local regions in an image produce important effects while mundane background regions do not contribute or even cause perceptual aliasing because of easy overlap. However, existing methods lack precisely modeling and full exploitation of these discriminative regions. In this paper, we propose the Focus on Local (FoL) approach to stimulate the performance of image retrieval and re-ranking in VPR simultaneously by mining and exploiting reliable discriminative local regions in images and introducing pseudo-correlation supervision. First, we design two losses, Extraction-Aggregation Spatial Alignment Loss (SAL) and Foreground-Background Contrast Enhancement Loss (CEL), to explicitly model reliable discriminative local regions and use them to guide the generation of global representations and efficient re-ranking. Second, we introduce a weakly-supervised local feature training strategy based on pseudo-correspondences obtained from aggregating global features to alleviate the lack of local correspondences ground truth for the VPR task. Third, we suggest an efficient re-ranking pipeline that is efficiently and precisely based on discriminative region guidance. Finally, experimental results show that our FoL achieves the state-of-the-art on multiple VPR benchmarks in both image retrieval and re-ranking stages and also significantly outperforms existing two-stage VPR methods in terms of computational efficiency. Code and models are available at https://github.com/chenshunpeng/FoL
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。