让AI自动进化代码能力,实现持续自我改进。
Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agents

- 基于达尔文进化思想,用基础模型生成新代码代理并迭代优化。
- 在SWE-bench上代码性能从20.0%提升至50.0%,Polyglot从14.2%升至30.7%。
- 适合对自进化AI、自动化算法发现感兴趣的开发者与研究者。
当前AI系统依赖人工设计的固定架构,无法自主持续改进。我们提出达尔文哥德尔机器(DGM),一种可自我修改代码的系统,通过编码基准实证验证每次改动。受达尔文进化和开放性研究启发,DGM维护一个代码代理档案库,从中采样并利用基础模型生成新版本,形成不断扩展的多样化高质量代理树,实现多路径并行探索。实验显示,DGM在SWE-bench上性能从20.0%提升至50.0%,Polyglot从14.2%增至30.7%。相比无自改进或开放探索的基线,表现显著更优。所有实验均采取沙箱隔离与人工监督等安全措施。DGM是迈向可自我进化的智能体的重要一步,能自主构建创新路径。
原文摘要 · Abstract (English)
Today's AI systems have human-designed, fixed architectures and cannot autonomously and continuously improve themselves. The advance of AI could itself be automated. If done safely, that would accelerate AI development and allow us to reap its benefits much sooner. Meta-learning can automate the discovery of novel algorithms, but is limited by first-order improvements and the human design of a suitable search space. The Gödel machine proposed a theoretical alternative: a self-improving AI that repeatedly modifies itself in a provably beneficial manner. Unfortunately, proving that most changes are net beneficial is impossible in practice. We introduce the Darwin Gödel Machine (DGM), a self-improving system that iteratively modifies its own code (thereby also improving its ability to modify its own codebase) and empirically validates each change using coding benchmarks. Inspired by Darwinian evolution and open-endedness research, the DGM maintains an archive of generated coding agents. It grows the archive by sampling an agent from it and using a foundation model to create a new, interesting, version of the sampled agent. This open-ended exploration forms a growing tree of diverse, high-quality agents and allows the parallel exploration of many different paths through the search space. Empirically, the DGM automatically improves its coding capabilities (e.g., better code editing tools, long-context window management, peer-review mechanisms), increasing performance on SWE-bench from 20.0% to 50.0%, and on Polyglot from 14.2% to 30.7%. Furthermore, the DGM significantly outperforms baselines without self-improvement or open-ended exploration. All experiments were done with safety precautions (e.g., sandboxing, human oversight). The DGM is a significant step toward self-improving AI, capable of gathering its own stepping stones along paths that unfold into endless innovation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。