用大模型自动进化生成多目标优化算法,效率比现有方法高60倍。
LLM-Driven Evolutionary Generation of Multi-Objective Bayesian Optimization Algorithms

- 用大模型做遗传算法的变异和交叉,自动生成完整优化算法
- 在12个测试问题上平均性能超基准算法,耗时降低60倍
- 生成的算法在真实工程问题中也表现更优,适合自动化优化设计
设计高效多目标贝叶斯优化(MOBO)算法需权衡众多相互依赖的设计选择,其最优配置高度依赖问题且通常需深厚专业知识。本文将LLaMEA框架扩展至MOBO,利用大语言模型作为进化策略中的变异与交叉算子,生成完整的算法实现,并将SMAC超参数优化集成进进化循环。经过九次进化运行,共生成约900个算法,在十二个合成问题(ZDT、DTLZ、WFG)和三个真实工程问题(RE)上进行评估,以BoFire qParEGO作为先进基准。在合成测试集中,最优生成算法的平均归一化超体积达0.971(对比qParEGO的0.869),耗时仅其约1/60;弗里德曼检验及事后分析表明二者属同一顶尖组,单问题测试显示该算法在12个问题中有7个显著优于qParEGO,从未更差,以数量级更低成本达到顶尖精度。在三个未见的真实工程问题上,生成算法取得最高平均归一化超体积0.985(对比qParEGO的0.971),在其中两个问题上显著更优,耗时降低约3.4倍,验证了性能优势可迁移至真实场景。因此,基于大模型的进化搜索能发现人工难以设计出的帕累托高效算法。
原文摘要 · Abstract (English)
Designing effective multi-objective Bayesian optimization (MOBO) algorithms requires balancing many interdependent design choices whose optimal configuration is problem-dependent and typically demands deep expertise. We extend the LLaMEA framework to MOBO, using large language models as mutation and crossover operators within evolutionary strategies to generate complete algorithm implementations, with SMAC hyperparameter optimization integrated into the evolutionary loop. Across nine evolutionary runs we generated approximately 900 algorithms and benchmarked them on twelve synthetic problems (ZDT, DTLZ, WFG) and three real-world engineering problems (RE), using a BoFire qParEGO implementation as a state-of-the-art Bayesian-optimization baseline. On the synthetic suite the strongest generated algorithm attains the highest mean normalized hypervolume (0.971, vs. 0.869 for qParEGO) while requiring roughly 60x less wall-clock time; a Friedman test with post-hoc analysis places the two in a single top-performing group, and per-problem tests find the generated algorithm significantly better than qParEGO on 7 of the 12 problems and never worse, matching state-of-the-art accuracy at an order-of-magnitude lower cost. On the three unseen real-world engineering problems a generated algorithm attains the best mean normalized hypervolume (0.985, vs. 0.971 for qParEGO)--significantly better than qParEGO on two of the three problems--at roughly 3.4x lower wall-clock cost, confirming that the gains transfer beyond the synthetic regime. LLM-driven evolutionary search can thus discover algorithm designs that achieve Pareto-efficient trade-offs difficult to reach through manual design.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。