系统梳理大模型在软件问题修复中的进展与挑战。
Advances and Frontiers of LLM-based Issue Resolution in Software Engineering: A Comprehensive Survey
- 从数据构建到训练方法,全面分析问题修复技术
- 揭示大模型在真实开发任务中仍存在显著缺陷
- 适合研究自主编程代理的学者和工程实践者
问题修复是软件工程中一项复杂且关键的任务,近年来成为人工智能的重要挑战。SWE-bench 等基准的建立揭示了大语言模型在此任务上的巨大难度,从而推动了自主编码代理的发展。本文系统综述该新兴领域:首先分析数据构建流程,涵盖自动化采集与合成方法;接着全面梳理方法体系,包括无需训练的模块化框架与基于训练的技术(如监督微调、强化学习);随后讨论数据质量与代理行为的关键评估;最后指出核心挑战并展望未来方向。相关开源资源已发布于 https://github.com/DeepSoftwareAnalytics/Awesome-Issue-Resolution。
原文摘要 · Abstract (English)
Issue resolution, a complex Software Engineering (SWE) task integral to real-world development, has emerged as a compelling challenge for artificial intelligence. The establishment of benchmarks like SWE-bench revealed this task as profoundly difficult for large language models, thereby significantly accelerating the evolution of autonomous coding agents. This paper presents a systematic survey of this emerging domain. We begin by examining data construction pipelines, covering automated collection and synthesis approaches. We then provide a comprehensive analysis of methodologies, spanning training-free frameworks with their modular components to training-based techniques, including supervised fine-tuning and reinforcement learning. Subsequently, we discuss critical analyses of data quality and agent behavior, alongside practical applications. Finally, we identify key challenges and outline promising directions for future research. An open-source repository is maintained at https://github.com/DeepSoftwareAnalytics/Awesome-Issue-Resolution to serve as a dynamic resource in this field.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。