让大模型搜索算法时记住策略方向,提升发现效率。
SeaEvo: Advancing Algorithm Discovery with Strategy Space Evolution

- 用自然语言描述策略并作为进化种群的持久状态
- 在四个系统基准上平均提升20.6%,最优单次运行提升3倍
- 适合需要高效算法探索的AI研究者和系统优化工程师
大语言模型引导的演化搜索常用于自动化算法发现,但现有方法主要依赖可执行程序和标量适应度评估。即使引入自然语言推理,也多为临时上下文或无结构记忆,未能形成对战略方向的持久种群级状态。这导致演化搜索难以区分语法不同但策略相同的实现,无法保留低适应度但有潜力的战略方向,也无法察觉整个策略族是否已饱和。我们提出 extit{SeaEvo},一个模块化策略空间层,将语言级战略推理转化为大语言模型驱动程序搜索中的第一类种群级演化状态。 extit{SeaEvo} 以显式自然语言策略表示每个候选程序,按策略语义聚类档案,检索行为互补的灵感,并定期导航策略景观以避开饱和方向。无需修改底层演化算法, extit{SeaEvo} 在算法发现、系统优化和代理支架设计任务中普遍提升现有演化主干性能。在四个系统基准上, extit{SeaEvo} 实现平均20.6%的相对提升,最佳单次运行在Prism上得分提升3倍。结果表明,持久策略表示为提升大语言模型引导演化搜索的有效性和成本效率提供了实用机制,指向可积累与复用算法策略的复合型智能系统。
原文摘要 · Abstract (English)
Large Language Model (LLM)-guided evolutionary search is increasingly used for automated algorithm discovery, yet most current methods track search progress primarily through executable programs and scalar fitness. Even when natural-language reasoning is used through heuristic descriptions or reflection, it typically remains transient mutation context or unstructured memory, rather than organized as persistent population-level state over strategic directions. As a result, evolutionary search can struggle to distinguish syntactically different implementations of the same idea, preserve lower-fitness but strategically promising directions, or detect when an entire family of strategies has saturated. We introduce \model, a modular strategy-space layer that turns language-level strategic reasoning into first-class population-level evolutionary state in LLM-driven program search. \model represents each candidate program with an explicit natural-language strategy, clusters the archive by strategy semantics, retrieves behaviorally complementary inspirations, and periodically navigates the strategy landscape to avoid saturated directions. Without modifying the underlying evolutionary algorithms, \model improves existing evolutionary backbones across algorithm discovery, systems optimization, and agent-scaffold design tasks in most settings. Across four systems benchmarks, \model achieves a 20.6% average relative improvement, with the best single run on Prism scoring 3$\times$ higher. These results suggest that persistent strategy representations provide a practical mechanism for improving the effectiveness and cost-efficiency of LLM-guided evolutionary search, pointing toward compound AI systems whose search capabilities benefit from the structured accumulation and reuse of algorithmic strategies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。