让视觉语言模型像苏格拉底一样反复追问,用证据推理遥感图像。
Asking like Socrates: Socrates helps VLMs understand remote sensing images
- 设计自洽对话式多智能体系统,引导模型迭代寻找视觉证据。
- 在多个遥感问答与定位任务上达到顶尖水平,准确率提升显著。
- 适合需要可信推理的遥感分析、智慧城市等场景使用。
近期受DeepSeek-R1启发的多模态推理模型虽推动了视觉语言系统发展,但在遥感任务中普遍存在伪推理现象:模型仅描述推理过程,而非基于视觉证据得出正确答案。我们将其归因于‘凝视效应’——对大规模遥感图像进行一次性粗粒度感知,导致理解不完整,推理依赖语言一致性而非视觉证据。为此,我们提出RS-EoT(遥感证据-思维),一种语言驱动、迭代式视觉证据搜寻范式。为实现该范式,提出SocraticAgent,一个通过交替推理与视觉检查循环生成推理轨迹的自博弈多智能体系统。为进一步强化和泛化该模式,采用两阶段渐进式强化学习策略:先在细粒度定位任务上训练以增强RS-EoT能力,再在遥感视觉问答任务上训练以推广至更广泛理解场景。实验表明,RS-EoT在多个遥感视觉问答与定位基准上达到当前最优表现。分析揭示清晰的推理与证据搜寻迭代循环,证实其有效缓解了凝视效应,实现了真正的证据驱动推理。代码、数据与模型已开源。
原文摘要 · Abstract (English)
Recent multimodal reasoning models, inspired by DeepSeek-R1, have significantly advanced vision-language systems. However, in remote sensing (RS) tasks, we observe widespread pseudo reasoning: models narrate the process of reasoning rather than genuinely reason toward the correct answer based on visual evidence. We attribute this to the Glance Effect, where a single, coarse perception of large-scale RS imagery results in incomplete understanding and reasoning based on linguistic self-consistency instead of visual evidence. To address this, we propose RS-EoT (Remote Sensing Evidence-of-Thought), a language-driven, iterative visual evidence-seeking paradigm. To instill this paradigm, we propose SocraticAgent, a self-play multi-agent system that synthesizes reasoning traces via alternating cycles of reasoning and visual inspection. To enhance and generalize these patterns, we propose a two-stage progressive RL strategy: first, RL on fine-grained Grounding tasks to enhance RS-EoT capabilities, followed by RL on RS VQA to generalize to broader understanding scenarios. Experiments show RS-EoT achieves state-of-the-art performance on multiple RS VQA and grounding benchmarks. Analyses reveal clear iterative cycles of reasoning and evidence seeking, confirming RS-EoT mitigates the Glance Effect and enables genuine evidence-grounded reasoning. Our code, data, and models are available at https://geox-lab.github.io/Asking_like_Socrates
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。