用四层模型量化团队AI配置成熟度,发现配置与否显著影响代码质量。
A Few Pages of Markdown: Committed AI Configuration and Lower Quality Cost after Coding-Agent Adoption

- 基于版本控制提交的AI配置行为构建四层成熟度模型
- 未配置的团队代码复杂度上升53%,警告数量增1.7倍
- 适合关注AI工具落地效果与技术债的研究者和管理者
编码代理虽提升开发速度,但带来技术债。现有研究仅报告整体平均效应,掩盖了团队间差异。本文提出RAMP(Repository AI Maturity Profile),一种基于版本控制提交物的四层累积成熟度模型,涵盖行为规范、编码标准、命名代理定义到多代理编排。441个仓库分析显示各层级具累积性,人工标注复现率达97%。73.8%的配置项仅提交一次且不再修改。分层重估发现,无论成熟度高低,代理均使提交量增加28%-38%;但质量分化明显:在代理先行的仓库中,无配置团队的认知复杂度增加53%(有配置为+27%),静态分析警告增长1.7倍。因成熟度为观察性指标,工程纪律或模型能力可能部分解释差距,结果仅为假设生成,已公开RAMP工具。
原文摘要 · Abstract (English)
Coding agents increase development velocity but also technical debt. Prior work reports only average effects across adopters, hiding wide differences between teams. We introduce RAMP (Repository AI Maturity Profile), a four-level cumulative maturity model grounded in version-controlled artifacts that teams commit to configure AI tools. RAMP runs from behavioral rules and coding standards through named agent definitions to multi-agent orchestration, with observed practice concentrated in the first three levels. Across 441 repositories the levels behave as a cumulative scale, and independent human annotation reproduces RAMP's repository-level labels on 97% of a held-out sample. Adoption is cumulative, forward-only, and set-and-forget: 73.8% of artifacts are committed once and never modified. Re-estimating an existing agent-adoption panel within each stratum, agents accelerate development regardless of maturity (28-38% more commits), but quality diverges: among agent-first repositories, where the contrast is identified, those without committed AI configuration show roughly twice the increase in cognitive complexity (+53% versus +27%) and 1.7x the increase in static-analysis warnings. Because maturity is observational, correlated engineering discipline or model capability may explain part of the gap; we present these findings as hypothesis-generating and release RAMP as a reusable instrument.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。