让智能体从自身经验中提炼计划抽象,实现自我优化。
Self-Abstraction from Grounded Experience for Plan-Guided Policy Refinement
- 通过任务执行后的经验提炼出关键步骤与约束的计划抽象
- 在SWE-Bench验证集上达到73.2%~74%的解决率,提升7.2%性能
- 适用于需多步推理的代码生成任务,适合高阶LLM代理开发
基于大语言模型(LLM)的智能体在需要多步推理和代码修改的软件工程任务中表现日益突出,但现有方法多依赖静态执行框架,缺乏从自身经验中学习并自我改进的机制。为此,我们提出自抽象框架SAGE,使智能体在初始执行后,从具体经验中提炼出简洁的计划抽象,包括关键步骤、依赖关系和约束条件,并将该抽象作为上下文指导反馈至策略中,实现更结构化、智能的后续执行。实证表明,SAGE在多种LLM架构和智能体设计中均带来稳定性能提升。在使用GPT-5(高)骨干时,相较强基线Mini-SWE-Agent提升7.2%相对性能;在SWE-Bench Verified基准上,分别达到73.2%和74%的Pass@1解决率,对应Mini-SWE-Agent与OpenHands CodeAct框架。
原文摘要 · Abstract (English)
Large language model (LLM) based agents are increasingly used to tackle software engineering tasks that require multi-step reasoning and code modification, demonstrating promising yet limited performance. However, most existing LLM agents typically operate within static execution frameworks, lacking a principled mechanism to learn and self-improve from their own experience and past rollouts. As a result, their performance remains bounded by the initial framework design and the underlying LLM's capabilities. We propose Self-Abstraction from Grounded Experience (SAGE), a framework that enables agents to learn from their own task executions and refine their behavior through self-abstraction. After an initial rollout, the agent induces a concise plan abstraction from its grounded experience, distilling key steps, dependencies, and constraints. This learned abstraction is then fed back as contextual guidance, refining the agent's policy and supporting more structured, informed subsequent executions. Empirically, SAGE delivers consistent performance gains across diverse LLM backbones and agent architectures. Notably, it yields a 7.2% relative performance improvement over the strong Mini-SWE-Agent baseline when paired with the GPT-5 (high) backbone. SAGE further achieves strong overall performance on SWE-Bench Verified benchmark, reaching 73.2% and 74% Pass@1 resolve rates with the Mini-SWE-Agent and OpenHands CodeAct agent framework, respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。