让遥感智能体学会从错误中积累经验,提升复杂任务执行能力。
RSMeM: Knowledge-Enhanced Memory Evolution for Remote Sensing Agents with Systematic Evaluation

- 用分层知识库引导规划与工具选择,结合失败日志提炼可复用约束
- 在EarthBench上使工具使用准确率提升6%,仅增加不到1%的推理开销
- 适合需要高可靠性遥感分析的科研人员和自动化系统开发者
地球科学研究依赖复杂的分析与领域知识,遥感观测是核心基础。然而,基于通用大模型的遥感智能体普遍缺乏领域专属性,导致流程脆弱且易出错,且错误难以沉淀为可复用经验。为此,我们提出RSMeM——一种增强型记忆演化机制,通过预蒸馏的领域知识启动智能体,并持续融合在线经验以实现稳健的多步工具执行。该机制包含两部分:(i) 分层知识锚定,对分层领域语料库进行语义感知检索,指导任务规划与工具选择;(ii) 失败感知经验优化,将带有失败标注的工具调用轨迹蒸馏为下一轮执行的约束条件。通过迭代应用这两项机制,智能体可逐步吸收任务级领域知识并转化为实例级执行经验。在EarthBench上的大量实验表明,RSMeM在多种大模型底座上均显著提升工具使用性能与端到端答案准确率。尤其在DeepSeek-V3.2上实现6%的准确率提升,额外消耗不足1%的上下文令牌,证明了蒸馏经验具有极高知识密度。
原文摘要 · Abstract (English)
Geoscience research requires complex analysis and domain expertise, with remote sensing (RS) observations as a key foundation. However, existing RS agents built on general-purpose LLMs remain largely domain-agnostic, resulting in brittle and error-prone workflows. Moreover, these failures are seldom consolidated into a reusable experience for subsequent analyses. To address this issue, we introduce RSMeM, a knowledge-enhanced memory evolution mechanism that bootstraps RS agents with pre-distilled domain knowledge and iteratively integrates online experience for robust multi-step tool execution. RSMeM is composed of two components: (i) Hierarchical Knowledge Grounding, which performs taxonomy-aware retrieval over a hierarchical domain corpus to guide planning and tool selection; and (ii) Failure-Aware Experience Refinement, which distills failure-annotated tool-use traces into reusable constraints for next-round tool execution. By iteratively employing these two processes, RS agents can evolve to absorb task-level domain knowledge and effectively translate it into instance-level execution experience. Extensive experiments on EarthBench demonstrate that RSMeM consistently improves tool-use performance and end-to-end answer across a diverse set of LLM backbones. Notably, RSMeM achieves a 6% accuracy improvement on DeepSeek-V3.2 with less than 1% additional experience tokens, demonstrating the strong knowledge density of our distilled experience.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。