arXiv:2605.01250cs.AI2026-05

构建可交互的地球观测分析环境,推动多模态智能体发展

EO-Gym: A Multimodal, Interactive Environment for Earth Observation Agents

论文配图:EO-Gym: A Multimodal, Interactive Environment for Earth Observation Agents
图 1 · 摘自论文原文
  • 设计多模态可交互环境,支持地理、时间与传感器跨模态操作
  • 包含9078条轨迹和3.46万步推理,基于8个公开数据集及遥感影像
  • 适用于遥感分析、智能决策等领域的研究者与开发者

地球观测(EO)分析本质上是交互式的:解决不确定性常需扩大兴趣区域、获取历史观测数据,并在光学与合成孔径雷达等传感器间切换。然而,现有大多数EO基准将此过程简化为固定输入、单轮任务。为此,我们提出EO-Gym,一个可控的可执行框架,用于多模态、工具使用型地球观测智能体,将EO分析建模为基于超过66万份按位置、时间和传感器类型索引的多模态文件的Gymnasium风格本地地理空间工作区,配备35种面向地球观测的专用工具,涵盖六类任务。在此基础上,我们构建了包含9,078条轨迹和34,604步推理步骤的基准数据集EO-Gym-Data,其基础为八个公共地球观测数据集以及Landsat和Sentinel-2影像。对10个开放与闭源视觉语言模型的评估显示,强大的通用模型在交互式地球观测推理方面仍表现不佳,尤其在时间序列与跨模态流程中。作为参考基线,通过在EO-Gym-Data上微调Qwen3-VL-4B-Instruct得到的EO-Gym-4B,在主评测设置下将总体Pass@3从0.49提升至0.74。EO-Gym为交互式地球观测智能体提供可复现环境,将地球观测操作化为需在地理、时间与感知模态间规划的证据搜集问题。

原文摘要 · Abstract (English)

Earth Observation (EO) analysis is inherently interactive: resolving uncertainty often requires expanding the region of interest, retrieving historical observations, and switching across sensors such as optical and Synthetic Aperture Radar. However, most EO benchmarks collapse this process into fixed-input, single-turn tasks. To address this gap, we present EO-Gym, a controlled executable framework for multimodal, tool-using EO agents that formulates EO analysis as a Gymnasium-style local geospatial workspace backed by more than 660k multimodal files indexed by location, time, and sensor type, with 35 EO-specialized tools spanning six task families. Built on this environment, we construct EO-Gym-Data, a benchmark of 9,078 trajectories and 34,604 reasoning steps, and grounded in eight public EO datasets together with Landsat and Sentinel-2 imagery. Evaluating $10$ open and closed VLMs shows that strong general-purpose models still struggle with interactive EO reasoning, especially on temporal and cross-modal workflows. As a reference baseline, EO-Gym-4B, obtained by fine-tuning Qwen3-VL-4B-Instruct on EO-Gym-Data, improves overall Pass@3 from $0.49$ to $0.74$ under the main evaluation setting. O-Gym provides a reproducible environment for interactive EO agents, operationalizing EO as an evidence-gathering problem that requires planning across geospatial, temporal, and sensing modality.

地球观测多模态智能体交互式

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。