arXiv:2510.10232cs.LGcs.AI2025-10被引 4

提出统计型自修改框架,实现安全递归优化。

SGM: A Statistical Godel Machine for Risk-Controlled Recursive Self-Modification

  • 用统计置信测试替代数学证明,确保每次修改安全
  • 在CIFAR-100上认证真实性能提升,ImageNet-100拒伪改进
  • 适合需持续进化且重视风险控制的智能系统

递归自修改在AutoML、神经架构搜索和自适应优化中日益关键,但现有框架无法保证安全。哥德尔机器通过要求改进的严格证明提供保障,但在随机、高维场景下难以实现。本文提出统计哥德尔机器(SGM),首个支持递归编辑的统计安全层。SGM以统计置信检验(e-value、Hoeffding界)替代证明要求,仅当改进在指定置信水平被认证时才允许修改,并分配全局误差预算以控制多轮累积风险。还提出确认触发谐波支出(CTHS),按确认事件而非轮次分配预算,聚焦于有前景的修改同时保持多重检验有效性。在监督学习、强化学习与黑箱优化任务中的实验验证其有效性:在CIFAR-100上认证真实增益,拒绝ImageNet-100上的虚假提升,并在强化学习与优化基准上展现鲁棒性。结果表明SGM可作为持续、风险感知自修改学习系统的基础设施。代码已公开:https://github.com/gravitywavelet/sgm-anon。

原文摘要 · Abstract (English)

Recursive self-modification is increasingly central in AutoML, neural architecture search, and adaptive optimization, yet no existing framework ensures that such changes are made safely. Godel machines offer a principled safeguard by requiring formal proofs of improvement before rewriting code; however, such proofs are unattainable in stochastic, high-dimensional settings. We introduce the Statistical Godel Machine (SGM), the first statistical safety layer for recursive edits. SGM replaces proof-based requirements with statistical confidence tests (e-values, Hoeffding bounds), admitting a modification only when superiority is certified at a chosen confidence level, while allocating a global error budget to bound cumulative risk across rounds.We also propose Confirm-Triggered Harmonic Spending (CTHS), which indexes spending by confirmation events rather than rounds, concentrating the error budget on promising edits while preserving familywise validity.Experiments across supervised learning, reinforcement learning, and black-box optimization validate this role: SGM certifies genuine gains on CIFAR-100, rejects spurious improvement on ImageNet-100, and demonstrates robustness on RL and optimization benchmarks.Together, these results position SGM as foundational infrastructure for continual, risk-aware self-modification in learning systems.Code is available at: https://github.com/gravitywavelet/sgm-anon.

自修改风险控制统计安全AutoML

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。