arXiv:2607.14115cs.AIcs.CL2026-07中稿 · CVPR

让地图定位像对话一样互动,通过问答逐步缩小位置范围。

DialogueVPR: Towards Conversational Visual Place Recognition

论文配图:DialogueVPR: Towards Conversational Visual Place Recognition
图 1 · 摘自论文原文
  • 将定位任务改为对话式推理,动态提问澄清模糊描述。
  • 在新数据集上实现比基线高18.7%的定位准确率提升。
  • 适合做智能导航、机器人定位或人机交互研究者参考。

受人类交流空间信息方式启发,语言引导的地理定位因其直观性和实用性受到关注。然而,现有方法多依赖静态单次检索,难以应对真实语言描述中的模糊与不完整问题。本文提出一种范式转变:将定位视为交互式的对话驱动推理过程,引入对话式地点识别(DlgPR)。为此,构建首个大规模对话式地点识别基准 DlgQuest-Cities,以及统一的推理框架,该框架结合跨模态多层级检索器与智能提问代理 DQ-pilot。DQ-pilot 采用分阶段训练:先在精选的 20,000 条样本上进行监督微调,再在更难的 10,000 条样本上通过 GRPO 进行强化学习优化。两项任务对齐指标指导训练:判别性难度指数(DDI)用于课程采样,位置检索增益(PRG)作为奖励信号直接衡量提问带来的检索改进。实验表明,该推理方法显著优于基线模型。代码与模型已开源。

原文摘要 · Abstract (English)

Inspired by how humans communicate spatial information, language-guided geo-localization has gained significant traction for its intuitive and practical value. Despite this progress, most methods still rely on a static, one-shot retrieval paradigm, which fails to handle the ambiguity and incompleteness inherent in real-world natural language descriptions. We propose a paradigm shift to reasoning retrieval and introduce Dialogue Place Recognition (DlgPR), which casts localization as an interactive, dialogue-driven reasoning process. To support this new task, we present DlgQuest-Cities, the first large-scale dialogue-based benchmark for place recognition, and a unified reasoning framework that couples a cross-modal multi-level retriever with an intelligent questioner, DQ-pilot. DQ-pilot is trained in a curriculum: supervised fine-tuning on a curated DQ-cities-20k subset followed by reinforcement refinement on a harder DQ-cities-10k split via GRPO. Two task-aligned metrics guide learning: a Discriminative Difficulty Index (DDI) for curriculum sampling and a Positional Retrieval Gain (PRG) reward that directly measures retrieval improvement induced by a question. Experiments show this reasoning-based approach significantly outperforms baselines. The code and model are available at https://github.com/Graysonggg/DlgPR.

视觉定位对话系统多模态智能导航

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。