用模块化智能体提升代码问题修复效果,性能超越现有方法10.22%。
Trae Agent: An LLM-based Agent for Software Engineering with Test-time Scaling
- 设计分模块的生成-筛选-选择智能体,解决大规模推理空间难题
- 在SWE-bench上达到75.20%的Pass@1,平均比基线高10.22%
- 适合关注大模型代码生成与工程应用的研究者和开发者
软件问题修复是软件工程中的关键挑战,近年来受广泛关注。随着大语言模型(LLMs)的快速发展,该领域已取得显著进展。现有基于提示的方法虽引入了集成推理技术,但仍受限于难以有效探索大规模集成空间,且缺乏对代码仓库级别的理解能力,影响整体性能。本文提出Trae Agent,首个面向仓库级问题修复的基于智能体的集成推理方法。该方法将目标建模为最优解搜索问题,通过生成、剪枝和选择三个模块化智能体,分别应对大规模集成空间和仓库级理解两大挑战。我们在SWE-bench基准上使用三种主流LLM进行实验,对比四种先进集成推理方法。结果表明,Trae Agent在所有基线上均表现更优,平均提升10.22%(Pass@1)。其在SWE-bench Verified排行榜中排名第一,达到75.20%的显著性能。项目已开源,资源详见https://github.com/bytedance/trae-agent。
原文摘要 · Abstract (English)
Software issue resolution is a critical challenge in software engineering and has garnered increasing attention in recent years. With the rapid advancement of large language models (LLMs), substantial progress has been made in addressing real-world software engineering tasks. Recent studies have introduced ensemble reasoning techniques to enhance the performance of LLM-based issue resolution. However, existing prompting-based methods still face limitations in effectively exploring large ensemble spaces and lack the capacity for repository-level understanding, both of which constrain their overall effectiveness. In this paper, we propose Trae Agent, the first agent-based ensemble reasoning approach for repository-level issue resolution. Trae Agent formulates our goal as an optimal solution search problem and addresses two key challenges, i.e., large ensemble spaces and repository-level understanding, through modular agents for generation, pruning, and selection. We conduct extensive experiments using three leading LLMs on the widely-adopted SWE-bench benchmark, comparing Trae Agent against four state-of-the-art ensemble reasoning techniques. Experimental results demonstrate that Trae Agent consistently achieves superior performance, with an average improvement of 10.22% over all baselines in terms of Pass@1. Trae Agent has achieved first place on the SWE-bench Verified leaderboard, with a notable Pass@1 score of 75.20%. We are pleased to release Trae Agent as an open-source project to support the research community, with all resources available at https://github.com/bytedance/trae-agent.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。