arXiv:2412.07507cs.LGcs.NE2024-12AAAI被引 26

用多任务强化学习打造通用进化算法配置器,一次训练适配多种优化场景。

ConfigX: Modular Configuration for Evolutionary Algorithms via Multitask Reinforcement Learning

  • 模块化设计灵活组合优化组件,生成多样化进化算法用于训练。
  • 预训练后零样本泛化性能超越现有最优基线,支持快速微调适应新任务。
  • 适合需要自动配置、跨问题迁移的进化算法研究与应用者。

近期基于元学习的黑箱优化(MetaBBO)进展表明,神经网络可动态配置进化算法(EAs),提升其在不同优化实例中的表现与适应性。然而,现有方法通常针对特定EA设计,限制了泛化能力,更换算法或问题需重新训练或重构。为此,我们提出ConfigX,一种新型MetaBBO范式,可学习一个通用配置代理模型以增强多种EAs。ConfigX首先引入新颖的模块化系统,实现训练期间多样化EAs的灵活组合;其次,采用基于Transformer的神经网络,通过设计联合优化任务空间中的多任务强化学习,元学习通用配置策略。大量实验验证,经大规模预训练后,ConfigX在未见任务上实现稳健零样本泛化,优于当前最先进基线。此外,该框架具备强持续学习能力,可通过微调高效适应新任务。ConfigX代表了迈向全自动、通用型进化算法配置代理的重要一步。

原文摘要 · Abstract (English)

Recent advances in Meta-learning for Black-Box Optimization (MetaBBO) have shown the potential of using neural networks to dynamically configure evolutionary algorithms (EAs), enhancing their performance and adaptability across various BBO instances. However, they are often tailored to a specific EA, which limits their generalizability and necessitates retraining or redesigns for different EAs and optimization problems. To address this limitation, we introduce ConfigX, a new paradigm of the MetaBBO framework that is capable of learning a universal configuration agent (model) for boosting diverse EAs. To achieve so, our ConfigX first leverages a novel modularization system that enables the flexible combination of various optimization sub-modules to generate diverse EAs during training. Additionally, we propose a Transformer-based neural network to meta-learn a universal configuration policy through multitask reinforcement learning across a designed joint optimization task space. Extensive experiments verify that, our ConfigX, after large-scale pre-training, achieves robust zero-shot generalization to unseen tasks and outperforms state-of-the-art baselines. Moreover, ConfigX exhibits strong lifelong learning capabilities, allowing efficient adaptation to new tasks through fine-tuning. Our proposed ConfigX represents a significant step toward an automatic, all-purpose configuration agent for EAs.

进化算法元学习强化学习配置优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。