arXiv:2512.02731cs.AIcs.LG2025-12被引 2

提出自博弈框架,揭示AI智能体自我提升的数学机制。

Self-Improving AI Agents through Self-Play

  • 用递归生成-验证-更新算子建模智能体演化流
  • 证明自提升系数κ>0需噪声足够小,且满足方差不等式
  • 统一语言自博弈、自我修正等方法为同一数学结构

我们将心理测量评估的模空间理论扩展至动力系统领域。此前工作将智能体能力定义为代理表示空间上的静态泛函,本文将智能体形式化为由计算资源r参数化的流ν_r,受递归生成-验证-更新(GVU)算子支配。我们证明该算子在参数流形Θ上生成一个向量场,并将自提升系数κ定义为能力泛函沿此流的李导数。本工作的核心贡献是推导出方差不等式——在温和正则性条件下,它是自提升稳定性的充分条件。我们表明,κ>0的充分条件是:在曲率与步长效应之外,生成与验证的联合噪声必须足够小。随后,我们将该形式化应用于统一近期关于语言自博弈(LSP)、自我修正和合成数据自举的文献。结果表明,STaR、SPIN、Reflexion、GANs和AlphaZero等架构是满足方差不等式的GVU算子的具体拓扑实现,其稳定性通过滤波、对抗判别或形式系统奠基得以保障。

原文摘要 · Abstract (English)

We extend the moduli-theoretic framework of psychometric batteries to the domain of dynamical systems. While previous work established the AAI capability score as a static functional on the space of agent representations, this paper formalizes the agent as a flow $ν_r$ parameterized by computational resource $r$, governed by a recursive Generator-Verifier-Updater (GVU) operator. We prove that this operator generates a vector field on the parameter manifold $Θ$, and we identify the coefficient of self-improvement $κ$ as the Lie derivative of the capability functional along this flow. The central contribution of this work is the derivation of the Variance Inequality, a spectral condition that is sufficient (under mild regularity) for the stability of self-improvement. We show that a sufficient condition for $κ> 0$ is that, up to curvature and step-size effects, the combined noise of generation and verification must be small enough. We then apply this formalism to unify the recent literature on Language Self-Play (LSP), Self-Correction, and Synthetic Data bootstrapping. We demonstrate that architectures such as STaR, SPIN, Reflexion, GANs and AlphaZero are specific topological realizations of the GVU operator that satisfy the Variance Inequality through filtration, adversarial discrimination, or grounding in formal systems.

自博弈智能体自提升动力系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。