arXiv:2608.05651cs.CLcs.AI2026-08被引 2

用廉价模型先探索,再把优质结果交给强模型精炼,省钱又高效。

Relay, Don't Route: Adaptive Population Handoff for Cost-Efficient LLM-Driven Evolution

论文配图:Relay, Don't Route: Adaptive Population Handoff for Cost-Efficient LLM-Driven Evolution
图 1 · 摘自论文原文
  • 按种群整体转移计算资源,而非单次调用,更契合进化搜索状态特性。
  • 在4个基准、3种预算下,11/12场景得分最高,省成本同时提性能。
  • 无需训练,通过带奖励的调度器自动决定何时交接种群,适合资源受限场景。

基于大语言模型(LLM)的进化方法在程序搜索与算法发现中展现出潜力,但全程依赖强模型代价高昂。现有方法多在单个查询或变异步骤层面分配模型,忽略了进化搜索的「状态依赖性」:每个生成候选都会改变后续变异的种群基础。我们实证分析了LLM驱动的进化轨迹,发现早期进展高度集中,早期表现虽有噪声但对后期效果有较强指示作用,且廉价模型可在更低开销下复现强模型的早期成果。受此启发,我们提出 extbf{ extit{model}},一个无需训练的框架,将预算分配从个体调用转向演化种群,实现自适应的「种群接力」。廉价模型在带宽调度器控制下分段探索多条轨迹,以构建高质量多样性的候选库作为交接依据,其收益(即「接力增益」)作为调度器奖励信号,决定是否移交。经筛选的候选初始化共享的强模型种群进行精炼。在四个基准和三种预算设置下, extbf{ extit{model}} 在12组实验中的11组取得最高平均得分,显著优于基线方法。结果表明,在状态依赖的搜索中,预算应围绕种群组织,而非个体调用。

原文摘要 · Abstract (English)

Large language model (LLM)-driven evolution has shown promise for program search and algorithm discovery, but relying on strong models throughout long evolutionary runs is costly. A natural alternative is to combine cheap and strong models under a fixed inference budget. However, existing approaches typically allocate models at the level of individual queries or mutation steps, overlooking that evolutionary search is \textit{stateful}: each generated candidate changes the population from which subsequent mutations are produced. We empirically analyze LLM-driven evolutionary trajectories and find that search progress is strongly front-loaded, early trajectory performance is informative but noisy, and cheap models recover much of the early progress achieved by strong models at lower cost. Motivated by these findings, we propose \textbf{\model}, a training-free framework that shifts budget allocation from individual calls to evolving populations through adaptive \textit{population handoff}. A cheap model explores multiple trajectories in short blocks allocated by a bandit scheduler. Relay Gain, defined as the marginal improvement of a compact, quality-diverse candidate bank constructed for handoff, serves as the scheduler reward and determines when to hand off. The curated candidates initialize a shared strong model population for refinement. Across four benchmarks and three budgets, \model achieves the highest mean score in 11 of 12 settings, outperforming competitive baselines. Our results suggest that in stateful search, budget allocation should be organized around the population, not the individual call.

LLM进化资源优化种群调度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。