让智能体自动设计并优化新智能体,持续提升任务能力。
Memento-Skills: Let Agents Design Agents
- 用可记忆的技能库和状态化提示,实现智能体自我演化。
- 在通用助手和人类末日考试中分别提升26.2%和116.2%准确率。
- 无需更新大模型参数,适合长期运行的自主系统开发。
我们提出一种通用、可持续学习的大语言模型智能体系统——Memento-Skills,该系统作为‘智能体设计者’,能自主构建、适应并改进特定任务的智能体。系统基于带状态提示的记忆强化学习框架,将可复用技能以结构化Markdown文件形式存储,作为持续演化的外部记忆。这些技能同时包含行为与上下文信息,使智能体可在交互中传递知识。从基础技能(如网页搜索、终端操作)出发,通过引入的‘读-写反思学习’机制持续优化:在‘读’阶段,行为可训练的技能路由根据当前状态提示选择最相关技能;在‘写’阶段,智能体依据新经验更新和扩展技能库。这种闭环设计实现了不更新大模型参数的持续学习,所有适应均通过外部技能与提示的演化完成。相比依赖人工设计的方案,Memento-Skills可端到端实现通用智能体对新任务的智能体自动生成。实验在General AI Assistants和Humanity's Last Exam基准上验证了持续性能提升,准确率分别提高26.2%和116.2%。代码已开源。
原文摘要 · Abstract (English)
We introduce \emph{Memento-Skills}, a generalist, continually-learnable LLM agent system that functions as an \emph{agent-designing agent}: it autonomously constructs, adapts, and improves task-specific agents through experience. The system is built on a memory-based reinforcement learning framework with \emph{stateful prompts}, where reusable skills (stored as structured markdown files) serve as persistent, evolving memory. These skills encode both behaviour and context, enabling the agent to carry forward knowledge across interactions. Starting from simple elementary skills (like Web search and terminal operations), the agent continually improves via the \emph{Read--Write Reflective Learning} mechanism introduced in \emph{Memento~2}~\cite{wang2025memento2}. In the \emph{read} phase, a behaviour-trainable skill router selects the most relevant skill conditioned on the current stateful prompt; in the \emph{write} phase, the agent updates and expands its skill library based on new experience. This closed-loop design enables \emph{continual learning without updating LLM parameters}, as all adaptation is realised through the evolution of externalised skills and prompts. Unlike prior approaches that rely on human-designed agents, Memento-Skills enables a generalist agent to \emph{design agents end-to-end} for new tasks. Through iterative skill generation and refinement, the system progressively improves its own capabilities. Experiments on the \emph{General AI Assistants} benchmark and \emph{Humanity's Last Exam} demonstrate sustained gains, achieving 26.2\% and 116.2\% relative improvements in overall accuracy, respectively. Code is available at https://github.com/Memento-Teams/Memento-Skills.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。