无需训练,通过对齐视觉层次特征实现跨视角地理定位
VFM-Loc: Training-Free Cross-View Geo-Localization via Aligning Discriminative Visual Hierarchies
- 利用预训练模型提取多尺度判别性视觉线索
- 在LO-UCV数据集上召回率@1提升超20%
- 适合需要快速部署的现实场景地理定位
遥感中的跨视角地理定位(CVGL)旨在通过匹配无人机视角查询图像与带地理标签的卫星图像来定位。尽管监督方法在封闭集基准上表现优异,但因视角差异大和数据集偏差,在真实开放场景中泛化能力差。为此,我们提出VFM-Loc,一种无需训练的CVGL框架,利用视觉基础模型(VFMs)的可迁移视觉表征。VFM-Loc通过渐进式对齐策略识别并匹配不同视角间的判别性视觉线索。首先设计基于广义均值池化与尺度加权R-MAC的分层线索提取机制,保留多尺度判别特征并维持层级置信度;其次引入基于域内PCA与正交普鲁斯特分析的统计流形对齐流程,线性对齐异构特征分布至共享度量空间。实验表明,VFM-Loc在标准基准上表现优异,在挑战性LO-UCV数据集上召回率@1超越监督方法超20%。该工作表明,对预训练特征进行合理对齐可有效弥合跨视角鸿沟,建立鲁棒、无需训练的现实世界CVGL范式。相关代码已开源:github.com/DingLei14/VFM-Loc。
原文摘要 · Abstract (English)
Cross-View Geo-Localization (CVGL) in remote sensing aims to locate a drone-view query by matching it to geo-tagged satellite images. Although supervised methods have achieved strong results on close-set benchmarks, they often fail to generalize to unconstrained, real-world scenarios due to severe viewpoint differences and dataset bias. To overcome these limitations, we present VFM-Loc, a training-free CVGL framework that leverages the generalizable visual representations from vision foundational models (VFMs). VFM-Loc identifies and matches discriminative visual clues across different viewpoints through a progressive alignment strategy. First, we design a hierarchical clue extraction mechanism using Generalized Mean pooling and Scale-Weighted R-MAC to preserve distinctive visual clues across scales while maintaining hierarchical confidence. Second, we introduce a statistical manifold alignment pipeline based on domain-wise PCA and Orthogonal Procrustes analysis, linearly aligning heterogeneous feature distributions in a shared metric space. Experiments demonstrate that VFM-Loc exhibits high accuracy on standard benchmarks and surpasses supervised methods by over 20\% in Recall@1 on the challenging LO-UCV dataset with large oblique angles. This work highlights that principled alignment of pre-trained features can effectively bridge the cross-view gap, establishing a robust and training-free paradigm for real-world CVGL. The relevant code is made available at: github.com/DingLei14/VFM-Loc.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。