arXiv:2412.08085cs.LGcs.AI2024-12被引 1

提出首个非贪婪多目标贝叶斯优化方法,提升实验设计效率。

Non-Myopic Multi-Objective Bayesian Optimization

  • 用超体积改进衡量多目标收益,构建非贪婪决策框架
  • 三种新采集函数使性能显著优于传统贪婪方法
  • 适合资源受限的材料设计等多目标优化场景

针对昂贵黑箱函数的有限时域多目标优化问题,本文提出首个非贪婪贝叶斯优化方法。现有单目标非贪婪方法依赖贝尔曼最优性原理,但该原理在多数多目标问题中不成立,因奖励函数需满足标量性、单调性和可加性。本文采用超体积改进(HVI)作为标量化手段,构造贝尔曼方程的下界,进而设计基于批量期望超体积改进(EHVI)的采集函数。提出三种非贪婪采集函数:嵌套型(Nested)、联合型(Joint)和基于二项分布近似的快速变体(BINOM)。在多个真实世界多目标优化任务上的实验表明,所提方法显著优于现有贪婪采集函数。

原文摘要 · Abstract (English)

We consider the problem of finite-horizon sequential experimental design to solve multi-objective optimization (MOO) of expensive black-box objective functions. This problem arises in many real-world applications, including materials design, where we have a small resource budget to make and evaluate candidate materials in the lab. We solve this problem using the framework of Bayesian optimization (BO) and propose the first set of non-myopic methods for MOO problems. Prior work on non-myopic BO for single-objective problems relies on the Bellman optimality principle to handle the lookahead reasoning process. However, this principle does not hold for most MOO problems because the reward function needs to satisfy some conditions: scalar variable, monotonicity, and additivity. We address this challenge by using hypervolume improvement (HVI) as our scalarization approach, which allows us to use a lower-bound on the Bellman equation to approximate the finite-horizon using a batch expected hypervolume improvement (EHVI) acquisition function (AF) for MOO. Our formulation naturally allows us to use other improvement-based scalarizations and compare their efficacy to HVI. We derive three non-myopic AFs for MOBO: 1) the Nested AF, which is based on the exact computation of the lower bound, 2) the Joint AF, which is a lower bound on the nested AF, and 3) the BINOM AF, which is a fast and approximate variant based on batch multi-objective acquisition functions. Our experiments on multiple diverse real-world MO problems demonstrate that our non-myopic AFs substantially improve performance over the existing myopic AFs for MOBO.

多目标优化贝叶斯优化非贪婪材料设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。