arXiv:2511.09820cs.CVcs.AI2025-11中稿 · WACV 2026, 10pages…

不训练即可实现街景到卫星图的精准匹配,靠地理信息与大模型推理。

From Street to Orbit: Training-Free Cross-View Retrieval via Location Semantics and LLM Guidance

  • 利用网络搜索和大模型推断位置,生成卫星查询图像。
  • 零样本下超越已有学习型方法,在基准数据集上表现更优。
  • 可自动生成语义对齐的数据集,适合无标注场景应用。

跨视图图像检索,尤其是街景到卫星图的匹配,对自动驾驶、城市规划及无GPS环境定位至关重要。然而现有方法通常需在精心构建的数据集上进行监督训练,并依赖全景或无人机图像,限制了实际部署。本文提出一种无需训练的跨视图检索框架,仅依赖预训练视觉编码器和大语言模型(LLM)。给定单目街景图像,该方法通过网络图像搜索和基于LLM的位置推断提取地理线索,利用地理编码接口生成卫星查询图像,并使用预训练视觉编码器(如DINOv2)结合PCA白化特征优化进行匹配检索。尽管未使用任何真实标签监督或微调,本方法在零样本设置下仍优于以往学习型方法。此外,其流程可自动构建语义对齐的街景-卫星数据集,为人工标注提供低成本高效替代方案。所有源代码将公开于 https://jeonghomin.github.io/street2orbit.github.io/。

原文摘要 · Abstract (English)

Cross-view image retrieval, particularly street-to-satellite matching, is a critical task for applications such as autonomous navigation, urban planning, and localization in GPS-denied environments. However, existing approaches often require supervised training on curated datasets and rely on panoramic or UAV-based images, which limits real-world deployment. In this paper, we present a simple yet effective cross-view image retrieval framework that leverages a pretrained vision encoder and a large language model (LLM), requiring no additional training. Given a monocular street-view image, our method extracts geographic cues through web-based image search and LLM-based location inference, generates a satellite query via geocoding API, and retrieves matching tiles using a pretrained vision encoder (e.g., DINOv2) with PCA-based whitening feature refinement. Despite using no ground-truth supervision or finetuning, our proposed method outperforms prior learning-based approaches on the benchmark dataset under zero-shot settings. Moreover, our pipeline enables automatic construction of semantically aligned street-to-satellite datasets, which is offering a scalable and cost-efficient alternative to manual annotation. All source codes will be made publicly available at https://jeonghomin.github.io/street2orbit.github.io/.

跨视图检索零样本大模型地理定位

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。