研究微软员工使用代码命令行智能助手的成效,发现使用率靠社交传播,活跃程序员留存高,且提交合并代码量提升24%。
Adoption and Impact of Command-Line AI Coding Agents: A Study of Microsoft's Early 2026 Rollout of Claude Code and GitHub Copilot CLI

- 通过社交网络推动工具使用,非强制推广
- 使用者平均多合并24%的代码请求
- 适合关注工程效率与团队协作的组织管理者
微软在2026年初对数十万名工程师推行命令行型代码智能助手(如Anthropic的Claude Code和GitHub Copilot CLI),旨在了解谁会尝试、谁会持续使用,以及工具是否带来足够产出以证明成本。研究发现,首次使用主要通过社交网络传播;留存率与编码活跃度相关,而非人口统计特征;采用者相比未采用者,合并的Pull Request(PR)数量高出约24%,且该提升在四个月内持续存在。以合并的PR作为产出代理指标(虽不等同于实际价值),结果表明这类工具并非普遍采用或短暂新奇效应,组织应将同行可见使用视为推广策略核心。
原文摘要 · Abstract (English)
Organizations rolling out agentic command line tools like Anthropic's Claude Code and GitHub's Copilot CLI need to know who will try them, who will keep using them, and whether the tools produce enough output to justify their cost. At organizational scale, token spend can run into millions of dollars annually, so misreading adoption, retention, or impact can make a rollout expensive without changing engineering velocity. Studying tens of thousands of engineers at Microsoft over its early-2026 rollout, we find that first use spread primarily through social networks, retention was associated more with engineers' coding activity than with demographics, and adopters merged roughly 24% more pull requests than they would have otherwise. We use merged pull requests as our proxy for output -- acknowledging that a merged PR is not the same as the value it delivers -- and the lift persists across our four-month window. These results suggest that CLI coding agents are neither uniformly adopted nor mere novelty effects and that organizations should treat visible peer use as central to rollout strategy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。