用Cursor编程提速但埋下技术债,长期反而更慢。
Speed at the Cost of Quality: How Cursor AI Increases Short-Term Velocity and Long-Term Complexity in Open-Source Projects
- 对比使用与未使用Cursor的项目,用差分法分析其影响。
- 短期开发速度飙升,但代码复杂度和警告数显著上升。
- 适合关注AI提效副作用的开发者和工具设计者。
大型语言模型(LLMs)在软件工程领域展现出革命性潜力,其中LLM代理正迅速成为开发主流,从业者报告效率提升数倍。然而,相关实证证据仍不足。本文通过先进的双重差分设计,比较采用流行LLM代理Cursor的GitHub项目与未使用Cursor的匹配对照组,评估其对开发速度和代码质量的影响。结果表明,采用Cursor带来统计上显著、大且短暂的项目级开发速度提升,同时静态分析警告数和代码复杂度显著且持续上升。进一步的面板广义矩估计显示,警告数和复杂度增加是长期速度下降的主要原因。研究指出,质量保障是早期采用Cursor者的重大瓶颈,呼吁将质量保障作为智能代理编程工具与AI驱动工作流设计的核心考量。
原文摘要 · Abstract (English)
Large language models (LLMs) have demonstrated the promise to revolutionize the field of software engineering. Among other things, LLM agents are rapidly gaining momentum in software development, with practitioners reporting a multifold increase in productivity after adoption. Yet, empirical evidence is lacking around these claims. In this paper, we estimate the causal effect of adopting a widely popular LLM agent assistant, namely Cursor, on development velocity and software quality. The estimation is enabled by a state-of-the-art difference-in-differences design comparing Cursor-adopting GitHub projects with a matched control group of similar GitHub projects that do not use Cursor. We find that the adoption of Cursor leads to a statistically significant, large, but transient increase in project-level development velocity, along with a substantial and persistent increase in static analysis warnings and code complexity. Further panel generalized-method-of-moments estimation reveals that increases in static analysis warnings and code complexity are major factors driving long-term velocity slowdown. Our study identifies quality assurance as a major bottleneck for early Cursor adopters and calls for it to be a first-class citizen in the design of agentic AI coding tools and AI-driven workflows.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。