用语义增量替代完整代码,让AI更高效地进化出科学解决方案
DeltaEvolve: Accelerating Scientific Discovery through Momentum-Driven Evolution
- 用语义增量捕捉程序修改的因果影响,替代冗余代码历史
- 在多领域任务中以更少的上下文tokens发现更优解
- 适合追求高效自动化科学发现的研究者
LLM驱动的演化系统在自动化科学发现中展现出潜力,但现有方法如AlphaEvolve依赖完整的代码历史,存在上下文效率低且演化指导弱的问题。本文首次将演化代理形式化为通用期望最大化框架:语言模型采样候选程序(E步),系统根据评估反馈更新控制上下文(M步)。在此视角下,以完整代码快照构建上下文属于次优的M步,因冗余实现细节稀释了核心算法思想,难以提供清晰的演化启发。为此,我们提出DeltaEvolve,一种基于动量的演化框架,用结构化的语义增量取代完整代码历史,捕捉前后节点修改对性能的影响机制。由于程序常具可分解性,语义增量通常包含多个可迁移的有效组件,能更有效驱动改进。通过多层次数据库与渐进披露机制组织语义增量,进一步降低输入token数量。在跨多个科学领域的任务上实证表明,该框架可在更低的token消耗下发现更优解。
原文摘要 · Abstract (English)
LLM-driven evolutionary systems have shown promise for automated science discovery, yet existing approaches such as AlphaEvolve rely on full-code histories that are context-inefficient and potentially provide weak evolutionary guidance. In this work, we first formalize the evolutionary agents as a general Expectation-Maximization framework, where the language model samples candidate programs (E-step) and the system updates the control context based on evaluation feedback (M-step). Under this view, constructing context via full-code snapshots constitutes a suboptimal M-step, as redundant implement details dilutes core algorithmic ideas, making it difficult to provide clear inspirations for evolution. To address this, we propose DeltaEvolve, a momentum-driven evolutionary framework that replaces full-code history with structured semantic delta capturing how and why modifications between successive nodes affect performance. As programs are often decomposable, semantic delta usually contains many effective components which are transferable and more informative to drive improvement. By organizing semantic delta through multi-level database and progressive disclosure mechanism, input tokens are further reduced. Empirical evaluations on tasks across diverse scientific domains show that our framework can discover better solution with less token consumption over full-code-based evolutionary agents.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。