通过逐步放大地图定位位置,实现更精准的跨视角地理定位。
Just Zoom In: Cross-View Geo-Localization via Autoregressive Zooming
- 用自回归方式逐级放大卫星图,逐步缩小目标范围。
- 在真实场景数据集上,50米内召回率提升5.5%,100米内提升9.6%。
- 无需对比学习和难样本挖掘,适合无GPS环境下的定位应用。
跨视角地理定位(CVGL)通过匹配街景图像与地理参考的俯视影像来估计相机位置,支持无GPS环境下的定位与导航。现有方法普遍将CVGL建模为对比学习嵌入空间中的图像检索问题,依赖大批次和难样本挖掘,且忽略地图的几何结构及街景与俯视影像间的覆盖差异。例如,街景中可见的显著地标可能超出固定卫星裁剪范围,导致检索目标模糊,限制了对地图的显式空间推理。我们提出「Just Zoom In」,一种基于自回归放大的城市级俯视图跨视角定位新范式。从粗略的卫星视图开始,模型通过一系列缩放决策逐步定位到目标分辨率的卫星单元,无需对比损失或难样本挖掘。我们还引入一个基于众包街景与高分辨率卫星影像的真实基准,反映实际拍摄条件。在该基准上,Just Zoom In 达到当前最佳性能,在50米内召回率提升5.5%,100米内提升9.6%。结果表明,自粗到细的序列化空间推理在跨视角地理定位中极具有效性。
原文摘要 · Abstract (English)
Cross-view geo-localization (CVGL) estimates a camera's location by matching a street-view image to geo-referenced overhead imagery, enabling GPS-denied localization and navigation. Existing methods almost universally formulate CVGL as an image-retrieval problem in a contrastively trained embedding space. This ties performance to large batches and hard negative mining, and it ignores both the geometric structure of maps and the coverage mismatch between street-view and overhead imagery. In particular, salient landmarks visible from the street view can fall outside a fixed satellite crop, making retrieval targets ambiguous and limiting explicit spatial inference over the map. We propose Just Zoom In, an alternative formulation that performs CVGL via autoregressive zooming over a city-scale overhead map. Starting from a coarse satellite view, the model takes a short sequence of zoom-in decisions to select a terminal satellite cell at a target resolution, without contrastive losses or hard negative mining. We further introduce a realistic benchmark with crowd-sourced street views and high-resolution satellite imagery that reflects real capture conditions. On this benchmark, Just Zoom In achieves state-of-the-art performance, improving Recall@1 within 50 m by 5.5% and Recall@1 within 100 m by 9.6% over the strongest contrastive-retrieval baseline. These results demonstrate the effectiveness of sequential coarse-to-fine spatial reasoning for cross-view geo-localization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。