让自演化智能体在安全约束下持续改进,避免自我欺骗。
Self-Evolving Agents with Anytime-Valid Certificates
- 用固定基模型+可调控适配器,限制自修改范围
- 通过实时验证门控机制,保证每次修改都在误差预算内
- 适合追求高可靠性自适应系统的研发者
自演化智能体打破了大多数学习理论保障的前提:数据、评估器、组件和假设空间均由待更新的策略生成。我们提出SEA架构,将自修改限制在小规模的转向适配器和围绕冻结基模型的版本化框架内,并通过一个随时有效的门控机制,对每次修改发放可审计的证书,确保在固定误差预算内。五个环路控制器整合了已发布的理论保障;由于这些门控只能从基模型已生成的行为中选择,因此五种验证器在环机制——最佳候选N、微步搜索、自撰复现预言机、搜索层控制与自修复——提供密集且无需评分者的信号,仅基于问题文本计算。在涵盖四个基模型的52个实例的SWE-bench Verified子集上,基模型能力是主导且无混杂效应的因素;在两个强基模型上,刻意设计的空操作复合控制将整体贡献分离至+4和+5(Glm 5.2: 24→28;Gpt: 29→34,达到65%最优水平),事件日志确认其机制正常触发并防止退化。结果为单次运行,依赖昂贵评估;未来工作包括确认运行间方差及任务级算法组合的自适应调整。
原文摘要 · Abstract (English)
Self-evolving agents violate the assumption behind most learning-theoretic guarantees: the data, evaluator, components, and hypothesis space are produced by the policy being updated. We present \textbf{SEA}, an architecture that confines self-modification to a small steering adapter and a versioned harness around a \emph{frozen} base model and admits each modification only through an anytime-valid gate that emits an auditable certificate against a fixed error budget. Five loop controllers compose published guarantees; because such gates can only \emph{select} among behaviors the frozen base already produces, five verifier-in-the-loop mechanisms -- best-of-$N$, micro-step search, self-authored reproduction oracles, search-layer control, and self-repair -- supply the dense, grader-free signal the gates require, computed from the issue text alone. On a $52$-instance SWE-bench Verified subset across four base models, base capability is the dominant, confound-free effect, and on two strong base models a deliberate no-op-composite control isolates the suite's contribution at $+4$ and $+5$ (\textsc{Glm}~5.2 $24\to28$; \textsc{Gpt} $29\to34$, the $65\%$ best), with event logs confirming that its mechanisms fire and prevent regressions. Results are single-run on expensive evaluations; confirming run-to-run variance and adapting the per-task algorithm mix are future work.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。