arXiv:2509.17808cs.LG2025-09被引 1

首个面向遥感的时空推理模型,可按方向生成连贯邻接影像。

Remote Sensing-Oriented World Model

  • 将遥感建模定义为方向引导的图像外推任务
  • 在1600个任务上超越现有模型,尤其在洪水与城市场景中表现优异
  • 适合灾害应急与城市规划领域的空间推理需求

世界模型在人工智能中展现出预测和推理超出直接观测世界状态的潜力。然而,现有方法主要在合成环境或受限场景中评估,难以验证其在具有广泛空间覆盖和复杂语义的真实世界中的有效性。与此同时,遥感应用亟需空间推理能力以支持灾害响应和城市规划。本文首次提出面向遥感的世界建模框架,将遥感世界建模定义为方向条件下的空间外推,即根据中心观测和方向指令生成语义一致的相邻图像块。为实现严格评估,我们构建了RSWISE(Remote Sensing World-Image Spatial Evaluation)基准,包含1600个评估任务,涵盖通用、洪水、城市和农村四种场景。RSWISE结合视觉保真度评估与指令遵循性评估,使用GPT-4o作为语义判官,确保模型真正执行空间推理而非简单复制。随后,我们提出RemoteBAGEL,一个在遥感数据上微调的统一多模态模型,用于空间外推任务。大量实验表明,RemoteBAGEL在RSWISE上持续优于当前最先进基线。

原文摘要 · Abstract (English)

World models have shown potential in artificial intelligence by predicting and reasoning about world states beyond direct observations. However, existing approaches are predominantly evaluated in synthetic environments or constrained scene settings, limiting their validation in real-world contexts with broad spatial coverage and complex semantics. Meanwhile, remote sensing applications urgently require spatial reasoning capabilities for disaster response and urban planning. This paper bridges these gaps by introducing the first framework for world modeling in remote sensing. We formulate remote sensing world modeling as direction-conditioned spatial extrapolation, where models generate semantically consistent adjacent image tiles given a central observation and directional instruction. To enable rigorous evaluation, we develop RSWISE (Remote Sensing World-Image Spatial Evaluation), a benchmark containing 1,600 evaluation tasks across four scenarios: general, flood, urban, and rural. RSWISE combines visual fidelity assessment with instruction compliance evaluation using GPT-4o as a semantic judge, ensuring models genuinely perform spatial reasoning rather than simple replication. Afterwards, we present RemoteBAGEL, a unified multimodal model fine-tuned on remote sensing data for spatial extrapolation tasks. Extensive experiments demonstrate that RemoteBAGEL consistently outperforms state-of-the-art baselines on RSWISE.

遥感空间推理世界模型多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。