用最优臂识别提升贝叶斯优化在多峰问题中的搜索效率
Best-Arm Identification-Based Trust Region Selection for Bayesian Optimization on Multimodal Functions
- 基于最优臂识别动态筛选信任区域,避免盲目探索
- 实验显示收敛速度优于传统贝叶斯优化,尤其在多峰场景
- 适合高维或复杂多峰函数的黑箱优化任务
基于高斯过程的贝叶斯优化(BO)是解决昂贵黑箱优化问题的常用方法,但在复杂多峰或高维问题上性能常下降。信任区域型BO通过聚焦局部区域缓解此问题,近期研究指出区域选择可建模为多臂赌博机问题。本文提出一种轨迹感知框架,将最优臂识别(BAI)与信任区域型BO结合,通过外推多个局部初始化优化器的轨迹来预测其最终表现,并利用BAI逐步剔除次优候选。理论上证明,在温和假设下,该BAI引导的BO比传统方法更快收敛至全局最优;在合成数据与真实世界基准上的大量实验验证了其有效性。
原文摘要 · Abstract (English)
Gaussian process-based Bayesian optimization (BO) is a popular approach for expensive black-box optimization, but its performance often degrades on complex multimodal or high-dimensional problems. Trust region-based BO mitigates this issue by focusing on local regions, and recent studies suggest that selecting an effective region can be formulated as a multi-armed bandit problem. We propose a trajectory-aware framework that integrates best-arm identification (BAI) with trust region-based BO to efficiently solve multimodal optimization problems. Our method extrapolates the optimization trajectories of multiple locally initialized optimizers to predict their final performance and progressively eliminates suboptimal candidates via BAI. We theoretically show that the proposed BAI-guided BO converges faster to the global optimum than conventional BO under mild assumptions, and demonstrate its effectiveness through extensive experiments on synthetic and real-world benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。