arXiv:2605.09764cs.NEcs.AI2026-05被引 5

用更聪明的搜索架构,省钱省力地替代大模型做进化搜索。

LEVI: Stronger Search Architectures Can Substitute for Larger LLMs in Evolutionary Search

论文配图:LEVI: Stronger Search Architectures Can Substitute for Larger LLMs in Evolutionary Search
图 1 · 摘自论文原文
  • 构建多样解库+智能变异路由,避免浪费算力
  • 在系统研究任务上成本低3.3至6.7倍,最优时降35倍
  • 适合资源有限但想高效做算法探索的研究者

基于大模型的进化方法(如AlphaEvolve)在数学、系统研究和算法发现等领域表现优异,但依赖前沿模型导致开销巨大。我们指出,现有框架的搜索分配方式是主因:解库缺乏多样性迫使更强突变;盲目使用大模型处理小改动;全量评估浪费大量推演。为此提出LEVI,一种以搜索架构为核心的进化框架,核心思想是更强的搜索设计可替代甚至超越更大模型。其改进包括:从初始即建立并持续维护多样解库;智能变异路由,合理分配大小模型任务;基于排名保持的代理基准,降低推演开销。在系统研究基准上,LEVI以3.3-6.7倍更低预算达成最高得分;单个问题上成本仅为原有方法的1/35。在提示优化任务中,性能媲美或超过GEPA,且推演预算不足其一半,覆盖四个不同基准。LEVI已开源,地址:https://github.com/ttanv/levi。

原文摘要 · Abstract (English)

LLM-guided evolutionary methods such as AlphaEvolve have proven effective in domains like math, systems research, and algorithmic discovery, but their reliance on frontier models makes each run expensive. We argue this is largely an artifact of how existing frameworks allocate search: archives that fail to preserve solution diversity force compensation through stronger mutation models; blind model use spends frontier dollars on local edits a smaller model could handle; and full-set evaluation wastes rollouts on redundant examples. We introduce LEVI, a harness-first evolutionary framework built on the bet that stronger search architectures can substitute for or even outperform larger LLMs in evolutionary search. LEVI improves on three core components of evolutionary search: a solution database that establishes diversity from the beginning, and then maintains it throughout the run; a smarter mutation router that plays into the strengths of large and small LLMs; and a rank-preserving proxy benchmark for rollout-heavy settings. Across systems-research benchmarks LEVI attains the highest score on a budget 3.3-6.7x smaller than the published frontier-model runs of existing frameworks like ShinkaEvolve, GEPA, and AdaEvolve; on one problem, LEVI matches the existing best at a 35x lower cost. On prompt optimization, LEVI matches or exceeds GEPA at less than half of its rollout budget on four different benchmarks. LEVI is available as an open-source framework at https://github.com/ttanv/levi.

进化搜索低成本推理架构优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。