arXiv:2602.00117cs.CVcs.AI2026-02被引 1

让普通人也能用自然语言完成遥感分析,生成可审计的代码。

IC-EO: Interpretable Code-based assistant for Earth Observation

  • 将自然语言指令转为可执行的遥感分析代码,支持分类、分割、检测等操作。
  • 在土地覆盖制图任务中准确率达64.2%,野火损毁评估达50%,显著优于通用模型。
  • 输出可验证代码,适合非专家用户和需要透明性的科研场景。

尽管计算机视觉取得进展,普通用户仍难以开展地球观测(EO)分析,需依赖专业知识与技术能力。现有系统多为黑箱预测,难于审计或复现。本文利用工具型大模型,提出一个对话式代码生成代理,将自然语言查询转化为可执行、可审计的Python工作流。该代理基于统一且易扩展的API,支持分类、分割、目标检测(定向边界框)、光谱指数与地理空间运算。通过三层次控制:工具级在公开遥感基准上的表现、代理级生成有效代码的能力、任务级在具体应用中的表现,实现对结果的精准把控。本文选取土地覆盖制图与野火后损毁评估两个典型任务进行验证。所提代理在土地覆盖制图上准确率达64.2%,显著高于GPT-4o的51.7%;在野火损毁评估中达50%,而对比模型为0%。生成代码具有可验证性,使遥感分析过程透明、可复现。

原文摘要 · Abstract (English)

Despite recent advances in computer vision, Earth Observation (EO) analysis remains difficult to perform for the laymen, requiring expert knowledge and technical capabilities. Furthermore, many systems return black-box predictions that are difficult to audit or reproduce. Leveraging recent advances in tool LLMs, this study proposes a conversational, code-generating agent that transforms natural-language queries into executable, auditable Python workflows. The agent operates over a unified easily extendable API for classification, segmentation, detection (oriented bounding boxes), spectral indices, and geospatial operators. With our proposed framework, it is possible to control the results at three levels: (i) tool-level performance on public EO benchmarks; (ii) at the agent-level to understand the capacity to generate valid, hallucination-free code; and (iii) at the task-level on specific use cases. In this work, we select two use-cases of interest: land-composition mapping and post-wildfire damage assessment. The proposed agent outperforms general-purpose LLM/VLM baselines (GPT-4o, LLaVA), achieving 64.2% vs. 51.7% accuracy on land-composition and 50% vs. 0% on post-wildfire analysis, while producing results that are transparent and easy to interpret. By outputting verifiable code, the approach turns EO analysis into a transparent, reproducible process.

遥感分析代码生成可解释性大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。