arXiv:2606.06741cs.AIcs.CL2026-06被引 4

让大模型在无监督环境下自建技能与验证机制,实现真正开放世界的自我进化。

OpenSkill: Open-World Self-Evolution for LLM Agents

论文配图:OpenSkill: Open-World Self-Evolution for LLM Agents
图 1 · 摘自论文原文
  • 从文档、代码库和网络中获取知识,自动生成可迁移的技能
  • 在无目标任务监督下,通过自建虚拟任务提升技能,自动化通过率达85%以上
  • 适合需长期自主演化的智能体,如通用机器人或复杂决策系统

自进化智能体需要部署后的持续适应,但现有方法依赖可利用的学习循环,如精心设计的技能、成功轨迹或验证信号。真实开放世界部署可能不提供任何这些支持,仅给出任务提示。本文研究开放世界自进化:智能体必须从零开始构建自身技能和验证信号,仅使用开放世界资源,且无目标任务监督。我们提出OpenSkill框架,通过从文档、代码仓库和网络中获取具身知识与验证锚点,将其合成可迁移技能,并基于锚点生成的虚拟任务对技能进行迭代优化,而非依赖目标答案。开放世界同时提供学习内容与无需监督的练习环境,目标任务监督仅用于最终评估。在三个基准和两个目标智能体上,OpenSkill达到最优自动通过率,且满足无监督约束。分析表明其技能可在不同模型间迁移,无需特定适配;自建验证器与真实结果高度一致,尽管从未接触过真实答案。

原文摘要 · Abstract (English)

Self-evolving agents requires adaptation after deployment, but existing approaches assume a usable learning loop, such as curated skills, successful trajectories, or verifier signals. Real open-world deployments may provide none of these, offering only a task prompt. In this work, we study open-world self-evolution, where an agent must build both its skills and its own verification signals from scratch, using open-world resources but no target-task supervision. We propose OpenSkill, a framework that bootstraps this loop: it acquires grounded knowledge and verification anchors from documentation, repositories, and the web, synthesizes them into transferable skills, and refines those skills against self-built virtual tasks grounded in the anchors rather than in target answers. The open world thus supplies both the knowledge to be learned and a supervision-independent practice environment, with target-task supervision reserved for final evaluation. Across three benchmarks and two target agents, OpenSkill attains the best automated pass rate while satisfying the no-supervision constraint. Analysis shows its skills transfer across models without model-specific adaptation, and its self-built verifier aligns with ground-truth outcomes despite never accessing them.

自进化大模型无监督学习智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。