用大模型生成优化算法,分析其行为差异,找到高效设计方法。
Behaviour Space Analysis of LLM-driven Meta-heuristic Discovery
- 通过大模型迭代演化黑箱优化算法,结合多种变异提示策略。
- 最佳配置在BBOB基准上收敛最快,面积最大,停滞最少。
- 适合对自动生成算法和行为分析感兴趣的研究者。
我们研究了由大语言模型驱动的元启发式优化算法在行为空间中的表现。基于使用GPT-4-mini的大型语言进化算法(LLaMEA)框架,我们迭代演化黑箱优化启发式算法,并在BBOB基准套件中的10个函数上进行评估。对比了六种采用不同变异提示策略的LLaMEA变体。每轮运行均记录探索、利用、收敛与停滞等动态行为指标,通过可视化投影与基于网络的表示进行分析。综合运用基于行为的投影、代码演化图、性能收敛曲线及行为搜索轨迹网络,结果揭示了不同配置在搜索动态与算法结构上的显著差异。特别地,同时采用代码简化提示与随机扰动提示的1+1精英演化策略,取得了最优性能,表现为最高的收敛曲线面积。行为空间可视化显示,高性能算法表现出更强的利用能力,更快的收敛速度,更少的停滞。研究证明,行为空间分析可解释为何某些大模型设计的启发式算法表现更优,并揭示大模型如何在开放且复杂的算法搜索空间中导航。这些发现为未来自适应大模型算法生成器的设计提供了关键洞见。
原文摘要 · Abstract (English)
We investigate the behaviour space of meta-heuristic optimisation algorithms automatically generated by Large Language Model driven algorithm discovery methods. Using the Large Language Evolutionary Algorithm (LLaMEA) framework with a GPT o4-mini LLM, we iteratively evolve black-box optimisation heuristics, evaluated on 10 functions from the BBOB benchmark suite. Six LLaMEA variants, featuring different mutation prompt strategies, are compared and analysed. We log dynamic behavioural metrics including exploration, exploitation, convergence and stagnation measures, for each run, and analyse these via visual projections and network-based representations. Our analysis combines behaviour-based projections, Code Evolution Graphs built from static code features, performance convergence curves, and behaviour-based Search Trajectory Networks. The results reveal clear differences in search dynamics and algorithm structures across LLaMEA configurations. Notably, the variant that employs both a code simplification prompt and a random perturbation prompt in a 1+1 elitist evolution strategy, achieved the best performance, with the highest Area Over the Convergence Curve. Behaviour-space visualisations show that higher-performing algorithms exhibit more intensive exploitation behaviour and faster convergence with less stagnation. Our findings demonstrate how behaviour-space analysis can explain why certain LLM-designed heuristics outperform others and how LLM-driven algorithm discovery navigates the open-ended and complex search space of algorithms. These findings provide insights to guide the future design of adaptive LLM-driven algorithm generators.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。