让AI像专家一样多轮搜索证据,精准定位照片拍摄地。
REVERSE: Reinforcing Evidence Verification and Search for Agentic Image geo-localization

- 设计多轮推理框架,决策看哪、查什么、信什么证据。
- 在Im2GPS3k和YFCC4k上超越强基线,接近更大模型表现。
- 构建带标注的搜索轨迹与过程奖励,强化中间决策学习。
图像地理定位旨在确定照片拍摄位置,常需超越可见地标识别。人类专家通过迭代流程:观察关键区域、形成位置假设、搜索外部证据,并随新线索修正判断。现有方法仅部分模拟此过程:直接预测忽略证据获取,检索增强方法虽引入外部信息,但对搜索位置、查询方式及噪声过滤等中间决策监督有限。本文提出REVERSE框架,强化证据搜索与验证间的互动,实现多轮智能体式推理。REVERSE训练三个中间决策:何处查看、查询内容、可信证据筛选。为此,构建带标注的工具引导轨迹,包含区域选择、搜索观测与地理信息证据标签,并引入视觉定位、查询有效性及证据区分度的过程奖励。离线搜索缓存使检索观测稳定可复用,支持对噪声结果的密集监督。使用40亿参数模型,REVERSE在Im2GPS3k和YFCC4k上优于强检索增强基线,媲美更大模型。代码已公开于https://github.com/yonglleee/REVERSE。
原文摘要 · Abstract (English)
Image geo-localization aims to determine where a photograph was taken, a task that often requires more than recognizing visible landmarks. Human experts typically solve it through an iterative workflow: they inspect informative regions, form location hypotheses, seek external evidence, and revise their judgments as new clues appear. Existing methods only partially capture this process: direct prediction methods bypass evidence acquisition altogether, while retrieval-augmented methods introduce external evidence but usually provide limited supervision on the intermediate decisions of where to search, how to query, and how to filter noisy results. We present REVERSE, a framework that reinforces the interplay between evidence search and verification to enable multi-turn agentic reasoning. REVERSE teaches three intermediate decisions: where to look, what to query, and what evidence to trust. To support this, we construct tool-grounded trajectories with annotated region selections, search observations, and geo-informative evidence labels, and introduce process rewards for visual grounding, query utility, and evidence discrimination. An offline search cache makes retrieval observations stable and reusable during reinforcement learning, enabling dense supervision over noisy search results. With a 4B model, REVERSE outperforms strong retrieval-augmented baselines and rivals substantially larger models on Im2GPS3k and YFCC4k. Code is available at https://github.com/yonglleee/REVERSE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。