arXiv:2509.25723cs.CV2025-09中稿 · ICLR被引 4

SAGE通过动态融合空间与视觉信息,提升图像位置识别的准确率。

SAGE: Spatial-visual Adaptive Graph Exploration for Efficient Visual Place Recognition

  • 构建在线地理-视觉图,动态调整样本组织方式
  • 在SPED数据集上仅用4096D全局描述符实现100%召回率@10
  • 适合需要高效精准定位的机器人与自动驾驶场景

视觉位置识别(VPR)需在外观、视角和环境变化下仍能鲁棒地检索带地理标签的图像。现有方法多聚焦于描述符微调或固定采样策略,忽略了训练过程中空间上下文与视觉相似性之间的动态交互。本文提出SAGE(Spatial-visual Adaptive Graph Exploration),一种统一的训练流程,通过联合优化局部特征聚合、训练期间样本组织及困难样本挖掘,增强细粒度的空间-视觉区分能力。引入轻量级软探测模块,在双线性聚合前从训练数据中学习补丁描述符的残差权重,强化显著局部线索。训练时重构一个在线地理-视觉图,融合地理邻近性与当前视觉相似性,使候选邻域反映嵌入空间的演化状态。为集中学习最具信息量的位置邻域,从高亲和性锚点出发,采用贪心加权团扩展采样器迭代扩展聚类。使用冻结的DINOv2骨干网络并结合参数高效的微调,SAGE在八个基准测试中达到最先进性能。特别地,仅使用4096D全局描述符即在SPED数据集上实现100%召回率@10。代码与模型已公开于https://github.com/chenshunpeng/SAGE。

原文摘要 · Abstract (English)

Visual Place Recognition (VPR) requires robust retrieval of geotagged images despite large appearance, viewpoint, and environmental variation. Prior methods focus on descriptor fine-tuning or fixed sampling strategies yet neglect the dynamic interplay between spatial context and visual similarity during training. We present SAGE (Spatial-visual Adaptive Graph Exploration), a unified training pipeline that enhances granular spatial-visual discrimination by jointly improving local feature aggregation, organize samples during training, and hard sample mining. We introduce a lightweight Soft Probing module that learns residual weights from training data for patch descriptors before bilinear aggregation, boosting distinctive local cues. During training we reconstruct an online geo-visual graph that fuses geographic proximity and current visual similarity so that candidate neighborhoods reflect the evolving embedding landscape. To concentrate learning on the most informative place neighborhoods, we seed clusters from high-affinity anchors and iteratively expand them with a greedy weighted clique expansion sampler. Implemented with a frozen DINOv2 backbone and parameter-efficient fine-tuning, SAGE achieves SOTA across eight benchmarks. Notably, our method obtains 100% Recall@10 on SPED only using 4096D global descriptors. The code and model are available at https://github.com/chenshunpeng/SAGE.

视觉定位图神经网络特征提取机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。