通过分步推理定位遥感图像中小目标,提升复杂查询准确性
GeoSearcher: Anchor-Guided Progressive Reasoning for Remote Sensing Visual Grounding with Process Supervision

- 将遥感定位建模为锚点引导的逐步推理过程
- 在三个数据集上超越现有最优方法,小目标定位更准
- 适合需要精准地理定位的遥感分析场景
最近的多模态大语言模型在视觉定位中展现出强大的跨模态理解与坐标生成能力,但将其应用于遥感视觉定位(RSVG)仍面临挑战。高分辨率遥感图像覆盖范围大,目标通常极小且被大量视觉相似干扰物包围,而查询常包含参考物体、空间关系和目标属性等多重线索。现有基于MLLM的方法通常将RSVG视为一步坐标生成,可能导致小目标定位不稳定、复杂查询效果差。为此,我们提出GeoSearcher,将RSVG重构为锚点引导的渐进式推理过程,通过两个耦合阶段实现:锚中心推理监督微调(ACR-SFT)与过程忠实组相对策略优化(PF-GRPO)。在ACR-SFT中,利用锚中心推理数据教会模型将关键视觉线索表示为锚点,并逐步整合其周围的定位、关系与属性线索;在PF-GRPO中,通过过程感知奖励(PAR)与推理信息样本选择器(RISS),联合评估关键推理步骤与目标定位,聚焦于更有利于提升渐进推理的样本。该设计将大规模视觉搜索转化为更受约束的局部推理过程。在DIOR-RSVG、OPT-RSVG和VRS-Bench上的大量实验表明,GeoSearcher优于现有最先进方法。项目代码将开源于https://github.com/wangdianyu954-xixi/GeoSearcher。
原文摘要 · Abstract (English)
Recent multimodal large language models (MLLMs) have shown strong cross-modal understanding and coordinate generation abilities in visual grounding. However, transferring these abilities to remote sensing visual grounding (RSVG) remains challenging. High-resolution remote sensing images usually cover large-scale scenes, where targets are often extremely small and surrounded by numerous visually similar distractors. Meanwhile, queries often contain multiple clues, such as reference objects, spatial relations, and target attributes. Existing MLLM-based methods usually formulate RSVG as one-step coordinate generation, which may lead to unstable predictions for small-object localization and complex queries. To address these challenges, we propose GeoSearcher, which reformulates RSVG as an anchor-guided progressive reasoning process and realizes it through two coupled stages: Anchor-Centric Reasoning Supervised Fine-Tuning (ACR-SFT) and Process-Faithful Group Relative Policy Optimization (PF-GRPO). In ACR-SFT, anchor-centric reasoning data are used to teach the model to represent key visual clues as anchors and progressively integrate location, relational, and attribute clues around them. In PF-GRPO, Process-Aware Reward (PAR) and Reasoning-Informative Sample Selector (RISS) further optimize this reasoning behavior by jointly evaluating key reasoning steps and target localization, while focusing training on samples that are more beneficial for improving progressive reasoning. Through this design, GeoSearcher transforms large-scale visual search into a more constrained local reasoning process. Extensive experiments on DIOR-RSVG, OPT-RSVG, and VRS-Bench show that GeoSearcher outperforms existing state-of-the-art methods. The project will be released at https://github.com/wangdianyu954-xixi/GeoSearcher.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。