用元学习自动设计优化算法,提升通用性和效率。
Toward Automated Algorithm Design: A Survey and Practical Guide to Meta-Black-Box-Optimization
- 融合元学习与进化计算,实现算法的自动设计。
- 对比多种学习方法,验证其在性能与泛化上的差异。
- 适合算法研究者和自动化系统开发者参考。
本文介绍元黑箱优化(MetaBBO)作为进化计算领域新兴方向,结合元学习方法辅助自动化算法设计。尽管取得进展,现有文献对关键方面总结不足且缺乏实践指导。为此,我们全面回顾了MetaBBO最新进展,提出统一定义并系统分类算法设计任务:算法选择、配置、解操作与生成。进一步总结当前方法背后的学习范式,包括强化学习、监督学习、神经演化及基于大语言模型的上下文学习。对代表性方法进行综合评估,分析其优化性能、计算效率与泛化能力。基于结果,提炼出提升泛化与学习效率的核心设计要素。最后展望该领域趋势与未来方向。相关文献将持续更新于 https://github.com/MetaEvo/Awesome-MetaBBO。
原文摘要 · Abstract (English)
In this survey, we introduce Meta-Black-Box-Optimization~(MetaBBO) as an emerging avenue within the Evolutionary Computation~(EC) community, which incorporates Meta-learning approaches to assist automated algorithm design. Despite the success of MetaBBO, the current literature provides insufficient summaries of its key aspects and lacks practical guidance for implementation. To bridge this gap, we offer a comprehensive review of recent advances in MetaBBO, providing an in-depth examination of its key developments. We begin with a unified definition of the MetaBBO paradigm, followed by a systematic taxonomy of various algorithm design tasks, including algorithm selection, algorithm configuration, solution manipulation, and algorithm generation. Further, we conceptually summarize different learning methodologies behind current MetaBBO works, including reinforcement learning, supervised learning, neuroevolution, and in-context learning with Large Language Models. A comprehensive evaluation of the latest representative MetaBBO methods is then carried out, alongside an experimental analysis of their optimization performance, computational efficiency, and generalization ability. Based on the evaluation results, we meticulously identify a set of core designs that enhance the generalization and learning effectiveness of MetaBBO. Finally, we outline the vision for the field by providing insight into the latest trends and potential future directions. Relevant literature will be continuously collected and updated at https://github.com/MetaEvo/Awesome-MetaBBO.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。