为AI参与的软件开发流程设计可执行协议语言,确保步骤不可跳过。
Specifying AI-SDLC Processes: A Protocol Language for Human-Agent Boundaries

- 提出领域专用语言定义AI开发流程为协议,分离意图与执行机制。
- 在SWE-bench验证中,流程执行使修复效果提升14-22分,远超自然语言指令。
- 适用于需要高可靠性、可审计的AI辅助开发团队,尤其适合复杂系统构建。
AI代理已成为软件开发生命周期中的核心成员,但当前团队使用的工具无法有效约束其行为:提示词编码的流程灵活却不可靠,而工作流形式化虽可强制执行,却无法建模自主代理。本文提出一种面向AI-SDLC流程的领域特定语言,将流程定义为协议,具备形式化抽象语法、良构性条件、操作语义和执行不变量,并围绕策略(声明意图)与机制(结构化强制)的分离设计。证明了任意良构协议在所有执行轨迹下均保持不变量,且对克莱因复合的编排循环封闭:步骤不可跳过,系构造所致。故障率分析显示,结构化强制可限制无声失败,将剩余失败转化为可审计的阻塞状态,且该优势存在能力阈值。通过仿真与端到端测试验证,相同修复方法在自然语言指令下无改进,而作为已验证、自修正流程执行时,在SWE-bench Verified上实现14-22分的显著且可复现提升;消融实验表明增益源于流程本身,且能力阈值与模型预测一致。随着基础模型趋同,正式指定且可执行的流程将成为持久的工程资产。
原文摘要 · Abstract (English)
AI agents now act as first-class members of the software development lifecycle, but the instruments teams use to direct them enforce nothing: process encoded in prompts is flexible but unenforceable, while workflow formalisms are enforceable but do not model autonomous agents. We propose a domain-specific language for specifying AI-SDLC processes as protocols, with formal abstract syntax, well-formedness conditions, operational semantics, and enforcement invariants, organised around a separation of policy (declared intent) from mechanism (structural enforcement). We prove that any well-formed protocol maintains its invariants on every execution trace, closed under Kleene composition of orchestration loops: protocol steps cannot be skipped, by construction. A failure-rate analysis derives two consequences: structural enforcement bounds silent failure while converting the remainder into visible, audited stalls, and the benefit carries a capability floor. We validate the design in simulation and end-to-end on SWE-bench Verified, where an identical bug-fix methodology yields no improvement delivered as prose instructions, but a significant, replicated 14-22 point gain when executed as a validated, self-correcting process; an ablation attributes the gain to the executed process itself, and the capability floor appears where the model predicts it. As foundation models converge, the durable engineering asset is the formally specified, executable process.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。