AI编程从辅助到全自动,需按6级阶梯推进。
The AI Codebase Maturity Model: From Assisted Coding to Fully Autonomous Systems
- 构建6级成熟度模型,每级靠反馈机制衔接
- 实测实现全自动化,缺陷修复快至30分钟
- 测试体系是升级关键,适合研发团队参考
AI编程工具广泛应用,但多数团队止步于人工提示与审查。本文提出AI代码库成熟度模型(ACMM),一个六级框架,描述代码库如何从基础辅助编程演进至完全自治系统。该模型受CMMI启发,每一级由特定反馈环拓扑定义,下一阶段必须依赖前一级的机制。通过100天维护KubeStellar Console项目(使用Claude Code Opus和GitHub Copilot从零构建)及部署Hive——首个实现第六级的开源多智能体编排系统,验证了该模型。当前系统含74个CI/CD工作流、32个夜间测试套件、91%代码覆盖率,可实现全天候缺陷修复时间低于30分钟。核心发现:AI开发系统的智能不在于模型本身,而在于其周边的指令、测试、指标与反馈机制。无法跳级,每级突破均需新增反馈机制。测试规模、覆盖率阈值与执行可靠性成为最关键投入。版本v2将模型扩展至六级,引入第六级(完全自治)及参考实现Hive,采用Beads实现跨智能体记忆连续性,并显示从第二级到第六级,PR吞吐量提升5倍,问题处理吞吐量提升37倍。
原文摘要 · Abstract (English)
AI coding tools are widely adopted, but most teams plateau at prompt-and-review without a framework for systematic progression. This paper presents the AI Codebase Maturity Model (ACMM), a 6-level framework describing how codebases evolve from basic AI-assisted coding to fully autonomous systems. Inspired by CMMI, each level is defined by its feedback loop topology - the specific mechanisms that must exist before the next level becomes possible. I validate the model through a 100-day experience report maintaining KubeStellar Console, a CNCF Kubernetes dashboard built from scratch with Claude Code (Opus) and GitHub Copilot, and through the initial production deployment of Hive - an open-source multi-agent orchestration system that realizes Level 6: full autonomy. The system currently operates with 74 CI/CD workflows, 32 nightly test suites, 91% code coverage, and achieves bug-to-fix times under 30 minutes - 24 hours a day. The central finding: the intelligence of an AI-driven development system resides not in the AI model itself, but in the infrastructure of instructions, tests, metrics, and feedback loops that surround it. You cannot skip levels, and at each level, the thing that unlocks the next one is another feedback mechanism. Testing - the volume of test cases, the coverage thresholds, and the reliability of test execution - proved to be the single most important investment in the entire journey. v2 extends the model from 5 to 6 levels, adding Level 6 (Fully Autonomous) with Hive as reference implementation and Beads for cross-agent memory continuity, plus throughput acceleration data showing 5x PR throughput and 37x issue throughput from Level 2 to Level 6.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。