动态重采样提升代码生成智能体表现,高效修正错误决策。
DARS: Dynamic Action Re-Sampling to Enhance Coding Agent Performance by Adaptive Tree Traversal
- 在关键节点动态选择替代动作,基于历史与执行反馈重构路径。
- 在SWE-Bench Lite上达55% pass@k,pass@1率达47%,优于现有开源框架。
- 适合需要高可靠性代码生成的自动化开发场景,尤其关注纠错能力。
大语言模型(LLMs)在自然语言处理、数据分析和软件开发等领域推动了自动化进程。在软件工程中,基于LLM的代码生成智能体因其能自动完成复杂任务、辅助调试并提升效率而备受关注。然而,现有方法常面临决策不佳的问题,需大量人工干预或采用低效的计算扩展策略。为此,我们提出动态动作重采样(DARS),一种新型推理时计算扩展方法,可更快更有效地从次优决策中恢复。传统智能体要么沿线性路径推进,要么依赖随机采样扩展计算量;而DARS通过在关键决策点分支出新路径,基于轨迹历史及前次尝试的执行反馈选择替代动作。我们在SWE-Bench Lite基准上评估该方法,结果显示其在Claude 3.5 Sonnet V2上实现55%的pass@k分数,且pass@1率达到47%,超越当前最优开源框架。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have revolutionized various domains, including natural language processing, data analysis, and software development, by enabling automation. In software engineering, LLM-powered coding agents have garnered significant attention due to their potential to automate complex development tasks, assist in debugging, and enhance productivity. However, existing approaches often struggle with sub-optimal decision-making, requiring either extensive manual intervention or inefficient compute scaling strategies. To improve coding agent performance, we present Dynamic Action Re-Sampling (DARS), a novel inference time compute scaling approach for coding agents, that is faster and more effective at recovering from sub-optimal decisions compared to baselines. While traditional agents either follow linear trajectories or rely on random sampling for scaling compute, our approach DARS works by branching out a trajectory at certain key decision points by taking an alternative action given the history of the trajectory and execution feedback of the previous attempt from that point. We evaluate our approach on SWE-Bench Lite benchmark, demonstrating that this scaling strategy achieves a pass@k score of 55% with Claude 3.5 Sonnet V2. Our framework achieves a pass@1 rate of 47%, outperforming state-of-the-art (SOTA) open-source frameworks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。