arXiv:2410.20848cs.NEcs.AI2024-10被引 23

用大模型+进化算法自动设计优化方案,提升跨领域适应性。

Deep Insights into Automated Optimization with Large Language Models and Evolutionary Algorithms

  • 大模型生成并优化算法策略,进化算法探索解空间。
  • 提出新范式,改进个体表示、变异算子和评估机制。
  • 适合研究自动化优化与AI辅助算法设计的学者。

设计启发式或元启发式优化方法通常需要大量人工干预,且难以在不同问题领域间泛化。将大语言模型(LLMs)与进化算法(EAs)结合,为克服这些局限提供了新途径。在此框架中,LLMs作为动态代理,可生成、优化和解释优化策略,而EAs则通过进化操作高效探索复杂解空间。该协同机制提升了搜索效率与创造性。本文首先系统回顾了近年LLMs在优化中的应用研究,聚焦其作为解生成器与算法设计者的双重功能;随后总结现有工作中的共性与价值设计,提出一种新型的LLM-EA自动化优化范式。围绕该范式,深入分析了个体表示、变异算子与适应度评估三项关键组件的创新方法,重点解决启发式生成与解探索中的挑战,尤其从提示工程角度切入。本系统的综述与深入分析有助于研究者更好理解当前进展,并推动LLMs与EAs融合在自动化优化中的发展。

原文摘要 · Abstract (English)

Designing optimization approaches, whether heuristic or meta-heuristic, usually demands extensive manual intervention and has difficulty generalizing across diverse problem domains. The combination of Large Language Models (LLMs) and Evolutionary Algorithms (EAs) offers a promising new approach to overcome these limitations and make optimization more automated. In this setup, LLMs act as dynamic agents that can generate, refine, and interpret optimization strategies, while EAs efficiently explore complex solution spaces through evolutionary operators. Since this synergy enables a more efficient and creative search process, we first conduct an extensive review of recent research on the application of LLMs in optimization. We focus on LLMs' dual functionality as solution generators and algorithm designers. Then, we summarize the common and valuable designs in existing work and propose a novel LLM-EA paradigm for automated optimization. Furthermore, centered on this paradigm, we conduct an in-depth analysis of innovative methods for three key components: individual representation, variation operators, and fitness evaluation. We address challenges related to heuristic generation and solution exploration, especially from the LLM prompts' perspective. Our systematic review and thorough analysis of the paradigm can assist researchers in better understanding the current research and promoting the development of combining LLMs with EAs for automated optimization.

自动化优化大模型进化算法提示工程

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。