GitHub Copilot让开源贡献量提升28%~40%,但更促进代码维护而非创新。
The Impact of Large Language Models on Open-source Innovation: Evidence from GitHub Copilot
- 利用Copilot上线时间差,对比支持与不支持R语言的项目
- 增量贡献增幅远超实质性贡献,活动量高的项目差异更明显
- 适合研究生成式AI对自由协作创新影响的研究者
大型语言模型(LLMs)正在重塑知识工作,但在自愿性、自主导向的开源创新中,其影响可能与组织环境不同。本文研究开源软件开发中的个体贡献如何集体推动创新。不同于产品创新的分类体系,开源中的创新需基于任务对贡献者的认知负荷区分:实质性贡献需创造性提出新功能,而增量贡献则依赖对现有代码的理解进行维护优化。利用GitHub Copilot于2021年10月上线这一自然实验,其支持Python但不支持R(因商业原因),形成可比生态间的外生分割。通过三种识别策略与两种分类方法,发现Copilot可用性使开源贡献增加28%至40%。增量贡献增幅显著高于实质性贡献,且在高活跃度项目中差距更明显,模型升级后该趋势加剧。说明当已有上下文有助于定义问题并约束解法时,LLM更有效,促使协同创新偏向对已有代码库的利用,而非探索新功能。本研究为生成式AI在知识经济中的因果效应提供了罕见的实地证据。
原文摘要 · Abstract (English)
Large Language Models (LLMs) are reshaping knowledge work, yet their impact on voluntary, self-guided open innovation forums (contributors choose tasks without managerial direction) may differ fundamentally from effects observed in organizational settings. We study this question in open-source software development, where individuals' contributions collectively drive innovation at a community level. Unlike product innovation, where typologies for classifying innovation are well established, knowledge work in open-source settings calls for a distinction grounded in the cognitive demand a task places on the contributor. Burgeoning literature distinguishes substantive contributions, which require creative problem formulation to introduce new functionality, from incremental contributions, which draw on comprehension of existing code to maintain and refine it. We exploit a natural experiment around GitHub Copilot's launch in October 2021, where Copilot supported languages like Python while not supporting R for business reasons, creating an exogenous partition between otherwise comparable ecosystems. Using three complementary identification strategies and two classification approaches, we find that Copilot availability increases open-source contributions by 28 to 40 percent. The increase in incremental contributions is significantly larger than the increase in substantive contributions across all specifications. This disparity is more pronounced in projects with higher activity levels and widens following a model upgrade: LLMs function more effectively when existing context helps define the problem and constrain solutions, tilting collaborative innovation toward exploitation of established codebases rather than exploration of new functionality. This paper provides a rare instance of causal field evidence on LLM effects, given the speed at which GenAI has exploded across the knowledge economy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。