arXiv:2601.05432cs.CVcs.AI2026-01ACL被引 9

让AI像人一样用地图推理定位,准确率提升近三倍。

Thinking with Map: Reinforced Parallel Map-Augmented Agent for Geolocalization

  • 引入地图辅助的智能体循环机制,模拟人类用地图找位置
  • 通过强化学习与并行测试时扩展,使定位准确率提升至22.1%
  • 构建真实世界图像基准MAPBench,评估更贴近实际场景

图像地理定位任务旨在仅凭视觉线索预测图片拍摄位置。现有大型视觉语言模型虽利用世界知识、思维链推理和智能体能力,却忽视了人类常用的方法——使用地图。本文提出具备「地图思考」能力的智能体框架,构建地图中的智能体循环机制。采用两阶段优化:先通过智能体强化学习提升采样效率,再结合并行测试时缩放策略,在最终预测前探索多条候选路径,这对地理定位至关重要。为评估在最新真实图像上的表现,我们构建了完全由真实图像组成的综合训练与评估基准MAPBench。实验表明,该方法在多数指标上超越现有开源与闭源模型,尤其将定位准确率(Acc@500m)从8.0%提升至22.1%,优于使用谷歌搜索/地图的Gemini-3-Pro。

原文摘要 · Abstract (English)

The image geolocalization task aims to predict the location where an image was taken anywhere on Earth using visual clues. Existing large vision-language model (LVLM) approaches leverage world knowledge, chain-of-thought reasoning, and agentic capabilities, but overlook a common strategy used by humans -- using maps. In this work, we first equip the model \textit{Thinking with Map} ability and formulate it as an agent-in-the-map loop. We develop a two-stage optimization scheme for it, including agentic reinforcement learning (RL) followed by parallel test-time scaling (TTS). The RL strengthens the agentic capability of model to improve sampling efficiency, and the parallel TTS enables the model to explore multiple candidate paths before making the final prediction, which is crucial for geolocalization. To evaluate our method on up-to-date and in-the-wild images, we further present MAPBench, a comprehensive geolocalization training and evaluation benchmark composed entirely of real-world images. Experimental results show that our method outperforms existing open- and closed-source models on most metrics, specifically improving Acc@500m from 8.0\% to 22.1\% compared to \textit{Gemini-3-Pro} with Google Search/Map grounded mode.

地理定位地图推理智能体强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。