arXiv:2412.11529cs.CV2024-12被引 2

解决街景与卫星图跨视图定位中的偏移问题,提升无卫星信号环境下的定位精度。

Cross-View Geo-Localization with Street-View and VHR Satellite Imagery in Decentrality Settings

  • 提出新方法AuxGeo,利用双模块优化定位准确率。
  • 在大偏移条件下仍保持高精度,优于现有方法。
  • 构建新数据集DReSS,覆盖多样地貌和大范围地理区域。

跨视图地理定位在无卫星信号环境(如灾害现场、城市峡谷、密林)中面临挑战,需匹配街景查询图像与带地理标签的航拍参考图像。现有研究多假设查询图像与参考图像中心对齐,或仅考虑有限偏移(即非对齐程度),难以反映真实场景中预建数据库无法保证每张查询图完美对齐的情况。而偏移度(decentrality)是关键因素:偏移越大,定位效率越高,但准确率下降。为此,本文提出DReSS数据集,涵盖大范围地理空间和多样化景观,聚焦偏移问题。同时设计AuxGeo方法,通过双模块——鸟瞰中间模块(BIM)与位置约束模块(PCM),结合多指标优化策略,有效缓解偏移带来的定位误差。大量实验表明,AuxGeo在新提出的DReSS数据集上表现超越此前方法,显著缓解大偏移问题,并在CVUSA、CVACT、VIGOR等公开数据集上达到当前最优水平。

原文摘要 · Abstract (English)

Cross-View Geo-Localization tackles the challenge of image geo-localization in GNSS-denied environments, including disaster response scenarios, urban canyons, and dense forests, by matching street-view query images with geo-tagged aerial-view reference images. However, current research often relies on benchmarks and methods that assume center-aligned settings or account for only limited decentrality, which we define as the offset of the query image relative to the reference image center. Such assumptions fail to reflect real-world scenarios, where reference databases are typically pre-established without the possibility of ensuring perfect alignment for each query image. Moreover, decentrality is a critical factor warranting deeper investigation, as larger decentrality can substantially improve localization efficiency but comes at the cost of declines in localization accuracy. To address this limitation, we introduce DReSS (Decentrality Related Street-view and Satellite-view dataset), a novel dataset designed to evaluate cross-view geo-localization with a large geographic scope and diverse landscapes, emphasizing the decentrality issue. Meanwhile, we propose AuxGeo (Auxiliary Enhanced Geo-Localization) to further study the decentrality issue, which leverages a multi-metric optimization strategy with two novel modules: the Bird's-eye view Intermediary Module (BIM) and the Position Constraint Module (PCM). These modules improve the localization accuracy despite the decentrality problem. Extensive experiments demonstrate that AuxGeo outperforms previous methods on our proposed DReSS dataset, mitigating the issue of large decentrality, and also achieves state-of-the-art performance on existing public datasets such as CVUSA, CVACT, and VIGOR.

地理定位跨视图匹配偏移处理遥感影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。