arXiv:2603.20028cs.SEcs.AI2026-03被引 4

AI与人类协作的软件交付流程显著提升效率和质量。

Orchestrating Human-AI Software Delivery: A Retrospective Longitudinal Field Study of Three Software Modernization Programs

  • 构建跨四阶段的协同平台,整合人类与AI agent
  • 项目周期缩短至原来的1/4,缺陷率下降74%
  • 适合关注AI在团队级研发中落地的工程实践者

现有AI在软件工程中的研究多聚焦个体任务完成,缺乏团队级交付证据。本研究对工业级平台Chiron开展纵向实地研究,覆盖三个真实现代化项目:一个约3万行代码的COBOL银行迁移、一个约40万行代码的大规模会计系统现代化、以及一个约3万行代码的.NET/Angular抵押贷款系统现代化。研究涵盖五种交付配置:传统基线及四个迭代版本(V1–V4)。基准对比了实际结果(各阶段耗时、任务量、验证阶段问题数、首次发布覆盖率)与模型结果(人员工日与资深工程师等效工日)。在基线人员配置下,组合项目总周数从36.0降至9.3;模型原始工日从1080.0降至232.5;资深等效工日从1080.0降至139.5;验证阶段问题负荷从每百任务8.03个降至2.09个;首次发布覆盖率从77.0%提升至90.5%。V3与V4引入验收标准验证、仓库原生评审及人机混合执行,同步提升速度、覆盖率与问题负载控制。研究支持核心观点:最大收益来自将AI嵌入协调工作流,而非作为孤立编码助手。

原文摘要 · Abstract (English)

Evidence on AI in software engineering still leans heavily toward individual task completion, while evidence on team-level delivery remains scarce. We report a retrospective longitudinal field study of Chiron, an industrial platform that coordinates humans and AI agents across four delivery stages: analysis, planning, implementation, and validation. The study covers three real software modernization programs -- a COBOL banking migration (~30k LOC), a large accounting modernization (~400k LOC), and a .NET/Angular mortgage modernization (~30k LOC) -- observed across five delivery configurations: a traditional baseline and four successive platform versions (V1--V4). The benchmark separates observed outcomes (stage durations, task volumes, validation-stage issues, first-release coverage) from modeled outcomes (person-days and senior-equivalent effort under explicit staffing scenarios). Under baseline staffing assumptions, portfolio totals move from 36.0 to 9.3 summed project-weeks; modeled raw effort falls from 1080.0 to 232.5 person-days; modeled senior-equivalent effort falls from 1080.0 to 139.5 SEE-days; validation-stage issue load falls from 8.03 to 2.09 issues per 100 tasks; and first-release coverage rises from 77.0% to 90.5%. V3 and V4 add acceptance-criteria validation, repository-native review, and hybrid human-agent execution, simultaneously improving speed, coverage, and issue load. The evidence supports a central thesis: the largest gains appear when AI is embedded in an orchestrated workflow rather than deployed as an isolated coding assistant.

人机协作软件现代化流程优化实证研究

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。