研究LLM多智能体如何高效完成软件工程任务
Designing LLM-based Multi-Agent Systems for Software Engineering Tasks: Quality Attributes, Design Patterns and Rationale
- 分析94篇论文提炼出代码生成等10类任务
- 发现功能适用性是设计首要关注质量属性
- 角色协作模式最常用,提升代码质量是核心动机
随着软件工程任务复杂度持续上升,多智能体系统(MASs)因其自主性和可扩展性成为研究与实践焦点。结合大语言模型(LLMs)的推理与规划能力,基于LLM的多智能体系统在软件工程领域的应用日益受到关注。然而,目前尚无专门研究系统探讨此类系统的設計,包括设计师关注的质量属性(QAs)、采用的设计模式及设计依据。为此,我们收集了94篇关于基于LLM的多智能体系统在软件工程任务中的论文,进行了系统研究。结果表明:(1)代码生成是十类已识别软件工程任务中最常见的应用;(2)功能适用性是设计师最关注的质量属性;(3)角色协作(Role-Based Cooperation)是16种设计模式中最常使用的模式;(4)提升生成代码质量是最主要的设计动因。基于研究结果,本文提出了支持软件工程任务的基于LLM的多智能体系统设计启示。
原文摘要 · Abstract (English)
As the complexity of Software Engineering (SE) tasks continues to escalate, Multi-Agent Systems (MASs) have emerged as a focal point of research and practice due to their autonomy and scalability. Furthermore, through leveraging the reasoning and planning capabilities of Large Language Models (LLMs), the application of LLM-based MASs in the field of SE is garnering increasing attention. However, there is no dedicated study that systematically explores the design of LLM-based MASs, including the Quality Attributes (QAs) on which designers mainly focus, the design patterns used by designers, and the rationale guiding the design of LLM-based MASs for SE tasks. To this end, we conducted a study to identify the QAs that LLM-based MASs for SE tasks focus on, the design patterns used in the MASs, and the design rationale for the MASs. We collected 94 papers on LLM-based MASs for SE tasks as the source. Our study shows that: (1) Code Generation is the most common SE task solved by LLM-based MASs among ten identified SE tasks, (2) Functional Suitability is the QA on which designers of LLM-based MASs pay the most attention, (3) Role-Based Cooperation is the design pattern most frequently employed among 16 patterns used to construct LLM-based MASs, and (4) Improving the Quality of Generated Code is the most common rationale behind the design of LLM-based MASs. Based on the study results, we presented the implications for the design of LLM-based MASs to support SE tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。