arXiv:2412.07186cs.LGcs.AI2024-12NeurIPS被引 11

用蒙特卡洛树搜索实现黑盒优化的自适应空间迁移,提升收敛速度。

Monte Carlo Tree Search based Space Transfer for Black-box Optimization

  • 基于MCTS动态划分、选择并优化学习到的子空间
  • 在合成函数与真实任务上优于现有迁移方法
  • 适合需要快速启动的黑盒优化场景

贝叶斯优化(BO)是求解计算代价高昂的黑盒优化问题的常用方法。然而,传统BO方法需从头开始解决每个新问题,导致收敛缓慢。近期研究尝试将BO扩展至迁移学习框架以加速优化,其中搜索空间迁移是最有前景的方法之一,在多项任务中表现出色。但现有方法或缺乏自适应机制,或灵活性不足,难以在优化过程中高效识别有潜力的搜索空间。本文提出一种基于蒙特卡洛树搜索(MCTS)的搜索空间迁移学习方法——MCTS-transfer,可迭代地在学习到的子空间中进行划分、选择与优化。该方法不仅能为热启动提供高性能搜索空间,还能在优化过程中自适应地利用相似源任务的信息重构搜索空间。在合成函数、真实问题、Design-Bench及超参优化任务上的实验表明,MCTS-transfer在不同设置下均显著优于其他搜索空间迁移方法。代码已公开于https://github.com/lamda-bbo/mcts-transfer。

原文摘要 · Abstract (English)

Bayesian optimization (BO) is a popular method for computationally expensive black-box optimization. However, traditional BO methods need to solve new problems from scratch, leading to slow convergence. Recent studies try to extend BO to a transfer learning setup to speed up the optimization, where search space transfer is one of the most promising approaches and has shown impressive performance on many tasks. However, existing search space transfer methods either lack an adaptive mechanism or are not flexible enough, making it difficult to efficiently identify promising search space during the optimization process. In this paper, we propose a search space transfer learning method based on Monte Carlo tree search (MCTS), called MCTS-transfer, to iteratively divide, select, and optimize in a learned subspace. MCTS-transfer can not only provide a well-performing search space for warm-start but also adaptively identify and leverage the information of similar source tasks to reconstruct the search space during the optimization process. Experiments on synthetic functions, real-world problems, Design-Bench and hyper-parameter optimization show that MCTS-transfer can demonstrate superior performance compared to other search space transfer methods under different settings. Our code is available at \url{https://github.com/lamda-bbo/mcts-transfer}.

黑盒优化迁移学习MCTS贝叶斯优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。