arXiv:2505.13025cs.LGcs.AI2025-05IJCAI被引 5

让优化器生成模型持续学习新问题,避免遗忘旧知识。

LiBOG: Lifelong Learning for Black-Box Optimizer Generation

  • 通过跨任务与内任务知识整合,缓解持续学习中的遗忘问题。
  • 在连续遇到新优化问题时仍能生成高性能优化器。
  • 适合需要长期迭代优化的自动化系统设计场景。

元黑箱优化(MetaBBO)因能自动化配置和生成黑箱优化器而受到关注,显著降低了人工设计优化器的负担,并发现性能优于传统人工设计的优化器。然而,现有MetaBBO方法依赖于静态问题分布及大量预设代表性训练样本,这一假设在真实场景中往往不成立,因为问题分布不断变化且新问题持续出现。因此,亟需可实时从新问题中持续学习并逐步提升能力的方法。本文提出一种全新的终身学习范式下的MetaBBO方法LiBOG,旨在从顺序遇到的问题中学习,并生成适用于黑箱优化(BBO)的高性能优化器。LiBOG通过跨任务与内任务的知识整合,有效缓解灾难性遗忘。大量实验表明,LiBOG能在终身学习框架下持续生成高性能优化器,同时保持对新任务的学习能力。

原文摘要 · Abstract (English)

Meta-Black-Box Optimization (MetaBBO) garners attention due to its success in automating the configuration and generation of black-box optimizers, significantly reducing the human effort required for optimizer design and discovering optimizers with higher performance than classic human-designed optimizers. However, existing MetaBBO methods conduct one-off training under the assumption that a stationary problem distribution with extensive and representative training problem samples is pre-available. This assumption is often impractical in real-world scenarios, where diverse problems following shifting distribution continually arise. Consequently, there is a pressing need for methods that can continuously learn from new problems encountered on-the-fly and progressively enhance their capabilities. In this work, we explore a novel paradigm of lifelong learning in MetaBBO and introduce LiBOG, a novel approach designed to learn from sequentially encountered problems and generate high-performance optimizers for Black-Box Optimization (BBO). LiBOG consolidates knowledge both across tasks and within tasks to mitigate catastrophic forgetting. Extensive experiments demonstrate LiBOG's effectiveness in learning to generate high-performance optimizers in a lifelong learning manner, addressing catastrophic forgetting while maintaining plasticity to learn new tasks.

元优化持续学习黑箱优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。