arXiv:2607.21832cs.SEcs.LG2026-07

实证分析AI代码代理在开发流程中的贡献与演变

How Do AI Coding Agents Contribute to Software Development? an Empirical Study of Agentic Pull Requests

论文配图:How Do AI Coding Agents Contribute to Software Development? an Empirical Study of Agentic Pull Requests
图 1 · 摘自论文原文
  • 对比分析AI与人工提交的代码请求(PR)差异
  • 发现AI PR合并率随时间变化,且任务类型分布呈季度演进
  • 揭示AI在提升效率的同时对软件质量的潜在影响

大型语言模型的快速发展使其在软件工程任务中广泛应用,人工智能代码代理已成为现代开发流程的重要组成部分。尽管开发者日益依赖这些代理,但其对软件质量的影响仍不明确,尤其是代理贡献在开发生命周期各阶段的演化尚未深入研究。本研究基于AIDev数据集,首先分析了AI生成与人工生成PR的合并率随时间的变化;其次识别出AI代理主要应用于哪些开发任务,并考察这些任务分布随季度的演变;最后对比两类PR的关键特征,关注其对软件质量的影响及时间动态性。结果提供了关于AI代码代理在真实开发实践中作用的实证与纵向视角,深化了对其优势与局限性的理解。

原文摘要 · Abstract (English)

Recent advances in large language models and their rapid adoption across software engineering tasks have made Artificial Intelligence (AI) coding agents an integral component of modern software development workflows. While developers increasingly benefit from these coding agents, their impact on software quality remains insufficiently understood. In particular, how agentic contributions evolve across the software development lifecycle has not been thoroughly investigated. This study aims to characterize agentic pull requests (PR) in comparison to human generated PRs and to examine how their properties change across different stages of the development lifecycle. Using the AIDev dataset, we first analyze how differences in merge rates between agentic and human generated PRs vary over time. We then identify the types of development tasks where AI coding agents are predominantly applied and investigate how these task distributions evolve across development quarters. Finally, we compare a set of key characteristics of agentic and human generated PRs, focusing on their implications for software quality and their temporal dynamics. Overall, our findings provide an empirical and longitudinal perspective on the role of AI coding agents in software development, offering a more nuanced understanding of their benefits and limitations in real-world practices.

AI编程代码生成实证研究

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。