arXiv:2601.04620cs.AI2026-01被引 5

将LLM智能体改进重构为可审计的发布工程,确保稳定升级不回退。

AgentDevel: Reframing Self-Evolving LLM Agents as Release Engineering

  • 把智能体看作可发布的软件,通过外部化流程实现改进
  • 在多个基准上减少显著回退,保持稳定提升
  • 适合需要可靠迭代的智能体开发团队

近期大型语言模型(LLM)智能体的研究多集中于在智能体内嵌自我改进机制或并行搜索多个变体。这些方法虽能提升整体得分,但常导致不稳定且难以审计的改进轨迹,难以保证不出现回退或跨版本故障分析。本文将智能体改进重新定义为**发布工程**:将智能体视为可发布的软件制品,将改进过程外部化为具有回归感知的发布流水线。我们提出**AgentDevel**,一个迭代运行当前智能体、从执行日志中生成无实现依赖的症状级质量信号、通过可执行诊断合成单一发布候选(RC)、并在以翻转为中心的门控机制下推进的发布工程流水线。AgentDevel包含三大核心设计:(i) 无实现依赖的LLM评议员,仅根据失败表现进行描述而不访问内部结构;(ii) 基于脚本的可执行诊断,聚合主导症状模式并生成可审计的工程规范;(iii) 以翻转为中心的门控机制,优先将“通过→失败”回退和“失败→通过”修复作为首要证据。与基于种群的搜索或智能体内自精炼不同,AgentDevel维护单一主干版本线,以非回退为核心目标。在执行密集型基准上的实验表明,AgentDevel实现了更稳定的改进,同时显著减少回退,并产出可复现、可审计的产物。总体而言,AgentDevel为构建、调试和发布LLM智能体提供了一套实用的开发范式。

原文摘要 · Abstract (English)

Recent progress in large language model (LLM) agents has largely focused on embedding self-improvement mechanisms inside the agent or searching over many concurrent variants. While these approaches can raise aggregate scores, they often yield unstable and hard-to-audit improvement trajectories, making it difficult to guarantee non-regression or to reason about failures across versions. We reframe agent improvement as \textbf{release engineering}: agents are treated as shippable artifacts, and improvement is externalized into a regression-aware release pipeline. We introduce \textbf{AgentDevel}, a release engineering pipeline that iteratively runs the current agent, produces implementation-blind, symptom-level quality signals from execution traces, synthesizes a single release candidate (RC) via executable diagnosis, and promotes it under flip-centered gating. AgentDevel features three core designs: (i) an implementation-blind LLM critic that characterizes failure appearances without accessing agent internals, (ii) script-based executable diagnosis that aggregates dominant symptom patterns and produces auditable engineering specifications, and (iii) flip-centered gating that prioritizes pass to fail regressions and fail to pass fixes as first-class evidence. Unlike population-based search or in-agent self-refinement, AgentDevel maintains a single canonical version line and emphasizes non-regression as a primary objective. Experiments on execution-heavy benchmarks demonstrate that AgentDevel yields stable improvements with significantly fewer regressions while producing reproducible, auditable artifacts. Overall, AgentDevel provides a practical development discipline for building, debugging, and releasing LLM agents as software development.

智能体发布工程稳定性可审计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。