arXiv:2503.05012cs.SEcs.AI2025-03被引 21

LLMs提升开发效率却带来质量权衡,影响开发者角色与团队协作。

LLMs' Reshaping of People, Processes, Products, and Society in Software Development: A Comprehensive Exploration with Early Adopters

  • 通过访谈16位早期使用者,分析LLM在开发全流程中的实际影响。
  • 生成代码效率高但需大量人工审核,形成‘写代码变审代码’的矛盾。
  • 适合关注人机协同、工具设计与教育变革的开发者与管理者阅读。

大型语言模型(LLMs)正在快速重塑软件开发,但其在整个开发周期中的影响尚不明确。现有研究多聚焦于代码生成或测试等孤立活动,未充分探讨其对开发者、流程、产品及软件生态的影响。本文通过对2023年初至中期的16位早期采用者进行半结构化访谈,将这些经验视为早期实证数据,结合近期相关研究,分析其使用模式的延续与变化。基于主题分析,从人员、流程、产品与社会四个维度展开:开发者报告了显著的生产力提升,体现在减少重复任务、加速搜索与调试;但同时也面临“生产力-质量悖论”——常放弃生成代码,转而投入更多精力评估与整合。LLM使用高度依赖开发阶段,主要集中在实现与调试,对需求收集等协作环节影响有限。参与者发展出新的能力,如提示工程、分层验证和安全集成以保护私有数据。他们预见到招聘标准、团队实践与计算机教育的变革,强调人类判断与基础软件工程技能仍至关重要。研究发现后被大规模量化研究验证,为开发者、组织、教育者与工具设计者提供负责任整合LLM的实践指导。

原文摘要 · Abstract (English)

Large language models (LLMs) are rapidly reshaping software development, but their impact across the software development lifecycle is underexplored. Existing work focuses on isolated activities such as code generation or testing, leaving open questions about how LLMs affect developers, processes, products, and the software ecosystem. We address this gap through semi-structured interviews with sixteen early-adopter software professionals who integrated LLM-based tools into their day-to-day work in early to mid-2023. We treat these interviews as early empirical evidence and compare participants' accounts with recent work on LLMs in software engineering, noting which early patterns persist or shift. Using thematic analysis, we organize findings around four dimensions: people, process, product, and society. Developers reported substantial productivity gains from reducing routine tasks, streamlining search, and accelerating debugging, but also described a productivity-quality paradox: they often discarded generated code and shifted effort from writing to critically evaluating and integrating it. LLM use was highly phase-dependent, with strong uptake in implementation and debugging but limited influence on requirements gathering and other collaborative work. Participants developed new competencies to use LLMs effectively, including prompt engineering strategies, layered verification, and secure integration to protect proprietary data. They anticipated changes in hiring expectations, team practices, and computing education, while emphasizing that human judgment and foundational software engineering skills remain essential. Our findings, later echoed in large-scale quantitative studies, offer actionable implications for developers, organizations, educators, and tool designers seeking to integrate LLMs responsibly into software practice today.

LLM应用开发效率人机协同软件工程

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。