arXiv:2410.01196stat.APcs.LG2024-10被引 5

提出EDU方法,高效寻找多个优质解以支持决策

Expected Diverse Utility (EDU): Diverse Bayesian Optimization of Expensive Computer Simulators

  • 基于高斯过程构建闭式采集函数,兼顾探索、利用与多样性
  • 在发动机控制与火星车路径优化中显著优于现有方法
  • 适合需要多备选方案的工程优化场景

昂贵的黑箱仿真器优化广泛存在于现代科学与工程中。贝叶斯优化通过拟合代理模型指导后续评估选择,但实际需求常非单一最优解,而是多个优质解构成的“备选集”,供下游决策使用。这一需求在飞行推进用内燃机实时控制中尤为关键,需多样控制策略保障飞行稳定。现有贝叶斯优化方法对此关注不足。本文提出期望多样效用(Expected Diverse Utility, EDU)方法,旨在搜索局部最优且距离全局最优不超过容忍度ε的多样化解。在高斯过程代理模型下,EDU可导出闭式采集函数,支持通过自动微分高效进行序列查询。该闭式表达揭示了探索-利用-多样性的新权衡机制,将多样性自然融入经典探索-利用框架。在一系列数值实验中,EDU表现优于现有方法;进一步在火星车轨迹优化与飞行推进发动机控制两个应用中验证其有效性。

原文摘要 · Abstract (English)

The optimization of expensive black-box simulators arises in a myriad of modern scientific and engineering applications. Bayesian optimization provides an appealing solution, by leveraging a fitted surrogate model to guide the selection of subsequent simulator evaluations. In practice, however, the objective is often not to obtain a single good solution, but rather a ``basket'' of good solutions from which users can choose for downstream decision-making. This need arises in our motivating application for real-time control of internal combustion engines for flight propulsion, where a diverse set of control strategies is essential for stable flight control. There has been little work on this front for Bayesian optimization. We thus propose a new Expected Diverse Utility (EDU) method that searches for diverse ``$ε$-optimal'' solutions: locally-optimal solutions within a tolerance level $ε> 0$ from a global optimum. We show that EDU yields a closed-form acquisition function under a Gaussian process surrogate model, which facilitates efficient sequential queries via automatic differentiation. This closed form further reveals a novel exploration-exploitation-diversity trade-off, which incorporates the desired diversity property within the well-known exploration-exploitation trade-off. We demonstrate the improvement of EDU over existing methods in a suite of numerical experiments, then explore the EDU in two applications on rover trajectory optimization and engine control for flight propulsion.

贝叶斯优化多样性搜索工程优化高斯过程

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。