让代码修复机器人学会总结经验,不再重复犯错。
SWE-Exp: Experience-Driven Software Issue Resolution
- 构建多维度经验库,保存成功与失败的修复过程。
- 在SWE-Bench验证集上达73.0%单次通过率,显著领先。
- 适合希望提升自动化修复能力的工程团队使用。
大型语言模型代理在软件问题修复中取得显著进展,采用多代理协作和蒙特卡洛树搜索等技术。然而,现有代理如同无记忆的探索者,每次问题独立处理,无法保留或复用过往修复经验,导致重复尝试失败路径,错失将成功方法迁移到相似问题的机会。为此,我们提出SWE-Exp,一种经验增强型方法,从先前代理轨迹中提炼简洁可操作的经验,实现跨问题持续学习。该方法构建多维度经验库,捕获从问题理解到具体代码修改的多层次修复知识。实验表明,SWE-Exp在SWE-Bench Verified数据集上使用最先进的LLM Claude 4 Sonnet,达到73.0%的Pass@1修复率,显著优于其他代理框架。本方法确立了新范式:自动化软件工程代理系统性积累并利用修复专长,从根本上将修复模式从试错探索转向战略性的经验驱动。
原文摘要 · Abstract (English)
Recent advances in large language model (LLM) agents have shown remarkable progress in software issue resolution, leveraging advanced techniques such as multi-agent collaboration and Monte Carlo Tree Search (MCTS). However, current agents act as memoryless explorers - treating each problem separately without retaining or reusing knowledge from previous repair experiences. This leads to redundant exploration of failed trajectories and missed chances to adapt successful issue resolution methods to similar problems. To address this problem, we introduce SWE-Exp, an experience-enhanced approach that distills concise and actionable experience from prior agent trajectories, enabling continuous learning across issues. Our method introduces a multi-faceted experience bank that captures both successful and failed repair attempts. Specifically, it extracts reusable issue resolution knowledge at different levels - from high-level problem comprehension to specific code changes. Experiments show that SWE-Exp achieves a Pass@1 resolution rate of 73.0% on SWE-Bench Verified using the state-of-the-art LLM Claude 4 Sonnet, significantly outperforming prior results under other agent frameworks. Our approach establishes a new paradigm in which automated software engineering agents systematically accumulate and leverage repair expertise, fundamentally shifting from trial-and-error exploration to strategic, experience-driven issue resolution.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。