用大模型演化解空间,大幅降低调用成本,提升复杂优化效率。
\(X\)-evolve: Solution space evolution powered by large language models
- 不直接进化单个解,而是进化由参数控制的解集合空间。
- 在三个难题上实现更优结果,最高减少99%的大模型调用次数。
- 适合解决高维、计算昂贵的优化问题,尤其适合资源受限场景。
将大语言模型(LLMs)与进化算法(EAs)结合有望解决复杂优化问题,但现有方法通常直接演化个体解,导致大模型调用成本高昂。我们提出X-evolve,一种范式革新方法:不再演化单个解,而是演化解空间X(即搜索空间S的子集)。在X-evolve中,大模型生成可调节程序,其中特定代码片段作为参数,定义一个可调的解空间。基于评分的搜索算法在该参数化空间中高效探索,并依据目标函数得分反馈进行引导。此策略实现了更广且高效的探索,显著加速收敛,同时将大模型调用次数降低至此前领先方法的1/100以下。我们在三个不同难度的优化问题上验证了X-evolve的有效性:在帽子集问题中,发现更大的部分可接受集,确立新的紧致渐近下界(C ≥ 2.2203);在信息论中,找到15顶点循环图(𝒞₁₅^(□5))更大的独立集(大小19,946),提升了其香农容量的已知下界;在NP难的在线装箱问题中,生成的启发式策略在标准基准测试中持续优于主流方法。通过演化解空间,本方法显著提升搜索效能,使原本计算不可行的高维问题成为可能。
原文摘要 · Abstract (English)
While combining large language models (LLMs) with evolutionary algorithms (EAs) shows promise for solving complex optimization problems, current approaches typically evolve individual solutions, often incurring high LLM call costs. We introduce \(X\)-evolve, a paradigm-shifting method that instead evolves solution spaces \(X\) (sets of individual solutions) - subsets of the overall search space \(S\). In \(X\)-evolve, LLMs generate tunable programs wherein certain code snippets, designated as parameters, define a tunable solution space. A score-based search algorithm then efficiently explores this parametrically defined space, guided by feedback from objective function scores. This strategy enables broader and more efficient exploration, which can potentially accelerate convergence at a much lower search cost, requiring up to two orders of magnitude fewer LLM calls than prior leading methods. We demonstrate \(X\)-evolve's efficacy across three distinct hard optimization problems. For the cap set problem, we discover a larger partial admissible set, establishing a new tighter asymptotic lower bound for the cap set constant (\(C \ge 2.2203\)). In information theory, we uncover a larger independent set for the 15-vertex cycle graph (\(\mathcal{C}_{15}^{\boxtimes 5}\), size 19,946), thereby raising the known lower bound on its Shannon capacity. Furthermore, for the NP-hard online bin packing problem, we generate heuristics that consistently outperform standard strategies across established benchmarks. By evolving solution spaces, our method considerably improves search effectiveness, making it possible to tackle high-dimensional problems that were previously computationally prohibitive.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。