让遥感智能体主动探索工具库,提升长任务推理效率。
RS-Claw: Progressive Active Tool Exploration via Hierarchical Skill Trees for Remote Sensing Agents

- 用分层技能树结构动态选择工具,先看摘要再加载详情。
- 在地球基准测试中压缩86%输入令牌,显著减少上下文负担。
- 适合需要复杂多步骤推理的遥感分析场景。
多模态大语言模型正推动遥感智能从“感知”转向“行动”,如OpenClaw框架使智能体能自主调用海量遥感图像处理工具完成复杂任务。现有遥感智能体采用被动工具选择机制,依赖全工具注册(Flat)或检索增强生成(RAG)。但在庞大且异构的遥感工具生态中,这类方法难以在任务推理过程中动态平衡“上下文负载”与“工具集完整性”,导致固有缺陷:全工具注册在长时任务中引发上下文空间不足,而RAG检索可能遗漏关键步骤中的必要工具。为此,本文重新定义工具选择为智能体在工具空间中的主动探索。基于此,提出RS-Claw新型遥感智能体架构。通过在工具端采用技能封装技术,该架构分层组织工具描述,使智能体可按需执行序列决策:先仅读取工具摘要选择相关技能分支,再动态加载详细描述,最终实现精准调用。这一主动范式不仅大幅释放智能体上下文空间,还有效保障长时推理中关键工具的准确命中率。在Earth-Bench基准上的系统性实验表明,RS-Claw的主动探索机制有效过滤语义噪声,显著释放推理空间,输入令牌压缩比最高达86%,并在复杂推理评估中全面超越现有Flat与RAG基线。
原文摘要 · Abstract (English)
The rise of multi-modal large language models (MLLMs) is shifting remote sensing (RS) intelligence from "see" to "action", as OpenClaw-style frameworks enable agents to autonomously operate massive RS image-processing tools for complex tasks. Existing RS agents adopt a passive selection paradigm for tool invocation, relying on either full tool registration (Flat) or retrieval-augmented generation (RAG). However, in the massive and multi-source heterogeneous RS tool ecosystem, such passive mechanisms struggle to dynamically balance "context load" and "toolset completeness" throughout task reasoning, thus exhibiting inherent limitations: full tool registration triggers context space deficits during long-horizon tasks, whereas RAG retrieval may omit critical tools in essential steps. To overcome these bottlenecks, this paper redefines tool selection by arguing that the agent should act as an active explorer within the tool space. Based on this perspective, we propose RS-Claw, a novel RS agent architecture. By leveraging Skill encapsulation technology at the tool end, this architecture hierarchically structures tool descriptions, enabling the agent to execute on-demand sequential decision-making: initially selecting relevant skill branches by reading only tool summaries, then dynamically loading detailed descriptions, and ultimately achieving precise invocation. This active paradigm not only significantly liberates the agent's context space but also effectively ensures the accurate hit rate of critical tools during long-horizon reasoning. Systematic experiments on the Earth-Bench benchmark demonstrate that RS-Claw's active exploration mechanism effectively filters semantic noise and substantially frees up reasoning space, achieving an input token compression ratio of up to 86%, and comprehensively outperforming existing Flat and RAG baselines across complex reasoning evaluations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。