让大模型自动构建可复用技能树,提升复杂任务解决能力。
OpenClaw-Skill: Collective Skill Tree Search for Agentic Large Language Models

- 通过多模型协作搜索与评估,自动生成多样且通用的技能节点。
- 在多个基准测试中展现卓越的长期规划与工具使用能力。
- 适合需要自主决策和持续学习的智能代理系统开发者。
为提升大语言模型代理在真实系统(如OpenClaw)中解决复杂任务的能力,本文提出一种基于树搜索的技能构建框架——集体技能树搜索(CSTS)。该框架通过两阶段迭代过程:集体技能节点生成(CSN-Gen)与集体技能节点评估(CSN-Assess),利用多模型协作探索并筛选有效技能。CSN-Gen从多模型中提取集体知识,生成多样化候选技能;CSN-Assess则通过多模型评分机制,分别评估技能质量与跨模型泛化能力。基于CSTS,我们构建了包含丰富技能的树状结构及增强训练数据,支持模型高效学习与应用技能。此外,引入集体技能强化学习,主动从技能树中选取多个相关技能,拓展解空间探索,避免单一技能导致的同质化或次优解。最终,训练出的OpenClaw-Skill模型在长周期规划、工具调用和跨任务泛化方面表现优异。
原文摘要 · Abstract (English)
Equipping Large Language Model (LLM) agents with effective skills is crucial for solving complex tasks in real-world systems like OpenClaw. In this work, we aim to develop a framework that automatically constructs such reusable skills to enhance LLMs in tool use, multi-step reasoning, and dynamic environment interaction. To this end, we propose Collective Skill Tree Search (CSTS), a novel tree-search-based skill construction framework that constructs structured, diverse and generalizable tree of skills. The core idea of CSTS is to leverage collective intelligence to jointly search, identify and compose effective skills via two iterative phases: Collective Skill Node Generation (CSN-Gen) and Collective Skill Node Assessment (CSN-Assess). CSN-Gen exploits collective knowledge from multiple models to explore diverse candidate skills for each subtask, enabling comprehensive skill exploration. CSN-Assess employs multiple models as judges to evaluate and select skill nodes with two scoring mechanisms: (1) collective quality scoring that aggregates independent evaluations to produce a robust estimate of skill effectiveness, and (2) collective transferability scoring that explicitly verifies whether a skill generalizes well across different models. With CSTS, we construct a set of comprehensive tree of skills along with skill-augmented training data, enabling models to effectively learn and utilize skills. Besides, we introduce Collective Skill Reinforcement Learning, which actively selects multiple relevant skills from the tree to broaden solution-space exploration, avoid being trapped by a single skill and its resulting homogeneous or suboptimal solutions. As a result, our trained model, OpenClaw-Skill, exhibits outstanding agentic capabilities in long-horizon planning, tool use and generalization over challenging benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。