解决代码修复中描述模糊的问题,提升AI工程师的准确率。
SWE-Fuse: Empowering Software Agents via Issue-free Trajectory Learning and Entropy-aware RLVR Training
- 用无问题描述样本训练,避开误导性信息。
- 高熵时放宽约束,低熵时收紧,稳定训练过程。
- 在真实项目中表现优秀,适合开发自动化修复工具的人看。
大型语言模型(LLMs)已深刻改变软件工程领域。尽管基于LLM的智能体在实际软件问题修复任务中表现出色,但仍面临关键挑战:高质量问题描述不足。真实数据集中问题描述与对应解决方案常存在错位,引入噪声和歧义,误导自动化代理并降低其求解能力。我们提出SWE-Fuse,一种面向问题描述的训练框架,融合有描述与无描述样本进行训练。包含两个核心模块:(1) 无问题描述驱动的轨迹学习模块,缓解误导性描述影响,同时学习逐步调试过程;(2) 基于熵感知的强化学习验证回归(RLVR)训练模块,通过熵驱动剪裁自适应调整训练动态,在高熵时放松剪裁以促进探索,低熵时严格剪裁以保障训练稳定性。我们在广泛使用的SWE-bench Verified基准上评估SWE-Fuse,结果表明其在解决真实软件问题方面效果显著。具体而言,相比最佳8B与32B基线,其求解率分别提升43.0%和60.2%。进一步结合测试时缩放(TTS),在TTS@8下,8B与32B模型求解率分别达到49.8%和65.2%。
原文摘要 · Abstract (English)
Large language models (LLMs) have transformed the software engineering landscape. Recently, numerous LLM-based agents have been developed to address real-world software issue fixing tasks. Despite their state-of-the-art performance, Despite achieving state-of-the-art performance, these agents face a significant challenge: \textbf{Insufficient high-quality issue descriptions.} Real-world datasets often exhibit misalignments between issue descriptions and their corresponding solutions, introducing noise and ambiguity that mislead automated agents and limit their problem-solving effectiveness. We propose \textbf{\textit{SWE-Fuse}}, an issue-description-aware training framework that fuses issue-description-guided and issue-free samples for training SWE agents. It consists of two key modules: (1) An issue-free-driven trajectory learning module for mitigating potentially misleading issue descriptions while enabling the model to learn step-by-step debugging processes; and (2) An entropy-aware RLVR training module, which adaptively adjusts training dynamics through entropy-driven clipping. It applies relaxed clipping under high entropy to encourage exploration, and stricter clipping under low entropy to ensure training stability. We evaluate SWE-Fuse on the widely studied SWE-bench Verified benchmark shows to demonstrate its effectiveness in solving real-world software problems. Specifically, SWE-Fuse outperforms the best 8B and 32B baselines by 43.0\% and 60.2\% in solve rate, respectively. Furthermore, integrating SWE-Fuse with test-time scaling (TTS) enables further performance improvements, achieving solve rates of 49.8\% and 65.2\% under TTS@8 for the 8B and 32B models, respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。