arXiv:2608.30277cs.AIcs.MA2026-08

用合成数据和检索增强训练,把大模型的遥感任务能力压缩到7B小模型。

SimCRAFT: Distilling Remote Sensing Agents via Synthetic Trajectories and Contextual Retrieval-Augmented Fine-Tuning

论文配图:SimCRAFT: Distilling Remote Sensing Agents via Synthetic Trajectories and Contextual Retrieval-Augmented Fine-Tuning
图 1 · 摘自论文原文
  • 通过多智能体生成带约束的遥感工作流数据集
  • 在14000条数据上训练,7B模型性能媲美闭源大模型
  • 适合资源受限场景下的遥感自动化部署

地球观测数据量与多样性激增暴露了传统人工流程的瓶颈,推动了遥感(RS)智能体的发展。然而,这些先进智能体严重依赖大规模通用大模型,缺乏领域专长且计算开销巨大。为此,我们提出SimCRAFT——一种模型无关框架,将复杂的遥感编排能力蒸馏至7B规模的小模型。为解决数据稀缺问题,我们设计多智能体合成引擎与模拟执行引擎协同生成符合格式、工具依赖与传感器兼容性的14,000条遥感工作流数据集(SimRS-14k)。其次,提出上下文检索增强微调(CRAFT),使模型通过适配检索到的标准操作流程,在噪声鲁棒目标下实现类比推理,无需机械复制即可泛化至多步遥感任务规划。大量实验表明,SimCRAFT-7B显著优于开源大模型,性能接近先进闭源模型及专用遥感智能体,并在三个7B基线模型上复现。本工作提供了一个轻量化、高性能的开源遥感智能基准,支持在资源受限或节能场景下的高效自主部署。

原文摘要 · Abstract (English)

The unprecedented surge in Earth observation data volume and diversity has exposed a critical bottleneck for traditional manual workflows, catalyzing the emergence of Remote Sensing (RS) Agents. However, the practical deployment of these advanced agents is severely hindered by their heavy reliance on large-scale general-purpose LLMs, which lack deep domain expertise and impose prohibitive infrastructure demands. To resolve this, we propose SimCRAFT, a model-agnostic framework that distills sophisticated RS orchestration capabilities into a compact 7B-scale model. Addressing data scarcity, we first pair a multiagent synthesis engine with a Mock Execution Engine that checks schema correctness, inter-tool dependencies, and sensor/tool compatibility, producing SimRS-14k, a large-scale, constraint-validated workflow planning corpus. Second, we propose Contextual Retrieval-Augmented Fine-Tuning (CRAFT) that finetunes the model to reason analogically by adapting retrieved Standard Operating Procedures to novel queries under a noise-robust objective, generalizing RAFT to multi-step RS workflow planning without mechanical copying. Extensive experiments demonstrate that SimCRAFT-7B significantly outperforms openweights LLMs and rivals advanced closedsource models and specialized RS agents, while reproducing across three 7B backbones. This work contributes a competitive open-weights baseline for lightweight RS intelligence, enabling efficient autonomous deployment under resource-constrained or resource-conserving conditions.

遥感智能模型蒸馏小模型工作流生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。