构建首个大规模AI代码生成合并冲突数据集,揭示其高发性与复杂性。
AgenticFlict: A Large-Scale Dataset of Merge Conflicts in AI Coding Agent Pull Requests on GitHub

- 从5.9万仓库中收集14.2万份AI生成的代码提交,模拟合并流程
- 发现27.67%的提交产生冲突,共33.6万处细粒度冲突区域
- 适用于研究AI协作开发、代码集成挑战或自动化测试的开发者
软件工程3.0标志着开发范式的转变,AI代码代理不再只是辅助工具,而是主动贡献者。尽管已有研究关注AI辅助开发的效率提升与接受度,但对代理生成内容整合所面临挑战的理解仍不足,尤其是合并冲突这一协作开发的核心问题。本文提出AgenticFlict,一个大规模的文本级合并冲突数据集,涵盖来自5.9万余个仓库的14.2万+份AI生成的代码提交(Agentic PRs),其中10.7万+份通过确定性合并模拟成功处理。分析识别出2.9万+份存在合并冲突的提交,冲突率达27.67%,提取出33.6万+个细粒度冲突区域。初步探索性分析表明,AI生成内容的合并冲突既频繁又显著,且在不同代理间存在明显差异,凸显了在AI辅助开发中理解与管理集成挑战的重要性。数据集、代码及补充材料已公开于Zenodo:https://doi.org/10.5281/zenodo.19396916。
原文摘要 · Abstract (English)
Software Engineering 3.0 marks a paradigm shift in software development, in which AI coding agents are no longer just assistive tools but active contributors. While prior empirical studies have examined productivity gains and acceptance patterns in AI-assisted development, the challenges associated with integrating agent-generated contributions remain less understood. In particular, merge conflicts, a fundamental aspect of collaborative software development, remain underexplored in this context. In this paper, we present AgenticFlict, a large-scale dataset of textual merge conflicts in AI coding agent pull requests (Agentic PRs). The dataset comprises 142K+ Agentic PRs collected from 59K+ repositories, of which 107K+ are successfully processed through deterministic merge simulation. Our pipeline identifies 29K+ PRs exhibiting merge conflicts, yielding a conflict rate of 27.67%, and extracts 336K+ fine-grained conflict regions across these instances. Our preliminary exploratory analysis indicates that merge conflicts are both frequent and often substantial in AI-generated contributions, with noticeable variation across agents, emphasizing the need to better understand and manage integration challenges in AI-assisted software development. The dataset, code and supplementary materials are available in zenodo: https://doi.org/10.5281/zenodo.19396916.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。