arXiv:2501.00967stat.MLcs.LG2025-01被引 6

用可解析方法提升复杂系统优化效率,兼顾物理规律与不确定性建模。

On the Implementation of a Bayesian Optimization Framework for Interconnected Systems

  • 通过自适应线性化构建复合函数的统计矩解析表达式
  • 在化工流程优化中比传统方法更快收敛且计算开销更低
  • 适合有物理结构或多重高斯过程耦合的复杂系统优化场景

贝叶斯优化(BO)是优化高成本采样系统的一种有效范式。标准BO使用高斯过程(GP)模型对系统性能函数 $f(x)$ 建模,将其视为黑箱,难以利用已知的结构性知识(如物理规律和稀疏互连)。灰箱建模将性能函数表示为已知与未知中间函数的组合 $f(x, y(x))$(其中 $y(x)$ 为GP模型),可缓解此问题;但当 $f$ 非线性时,从 $y(x)$ 的高斯分布推导 $f$ 的解析概率密度通常不可行。以往工作通过采样或在扩展空间求解带置信区间约束的辅助问题来处理,但计算代价高。本文详细实现了近期提出的灰箱贝叶斯优化框架——BOIS,其利用自适应线性化获得复合函数统计矩的解析表达式。结果表明,该方法能有效利用互联系统中的结构知识,以及嵌套多个GP模型或物理与GP混合系统的先验信息。我们在两个案例研究(化学工艺优化与设计)中对比了BOIS与标准BO及现有灰箱方法,结果显示,BOIS性能不劣于甚至优于现有方法,同时计算成本更低。

原文摘要 · Abstract (English)

Bayesian optimization (BO) is an effective paradigm for the optimization of expensive-to-sample systems. Standard BO learns the performance of a system $f(x)$ by using a Gaussian Process (GP) model; this treats the system as a black-box and limits its ability to exploit available structural knowledge (e.g., physics and sparse interconnections in a complex system). Grey-box modeling, wherein the performance function is treated as a composition of known and unknown intermediate functions $f(x, y(x))$ (where $y(x)$ is a GP model) offers a solution to this limitation; however, generating an analytical probability density for $f$ from the Gaussian density of $y(x)$ is often an intractable problem (e.g., when $f$ is nonlinear). Previous work has handled this issue by using sampling techniques or by solving an auxiliary problem over an augmented space where the values of $y(x)$ are constrained by confidence intervals derived from the GP models; such solutions are computationally intensive. In this work, we provide a detailed implementation of a recently proposed grey-box BO paradigm, BOIS, that uses adaptive linearizations of $f$ to obtain analytical expressions for the statistical moments of the composite function. We show that the BOIS approach enables the exploitation of structural knowledge, such as that arising in interconnected systems as well as systems that embed multiple GP models and combinations of physics and GP models. We benchmark the effectiveness of BOIS against standard BO and existing grey-box BO algorithms using a pair of case studies focused on chemical process optimization and design. Our results indicate that BOIS performs as well as or better than existing grey-box methods, while also being less computationally intensive.

贝叶斯优化灰箱建模化工优化高斯过程

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。