arXiv:2605.07565cs.LGcs.AI2026-05

解决环境变化下的贝叶斯优化难题,提升连续上下文场景的鲁棒性。

Ensemble Distributionally Robust Bayesian Optimisation with Continuous Context

  • 用集成代理模型+瓦瑟斯坦球不确定性集,同时处理函数拟合与上下文不确定。
  • 理论证明累积遗憾为O(γ_T √T),γ_T为集成模型最大信息增益。
  • 无需离散化,适用于连续上下文,适合工业优化等高风险场景。

我们研究在目标函数受未知概率分布控制的不可控环境上下文影响下的贝叶斯优化问题。实践中,上下文分布需从经验数据估计,此过程必然引入分布不匹配,导致次优结果。虽然分布鲁棒优化(DRO)可缓解此类风险,但现有鲁棒贝叶斯优化方法常面临计算复杂度高、依赖连续上下文空间离散化或对模糊集结构施加严格假设等问题。为此,我们提出集成分布鲁棒贝叶斯优化(EDRBO)。该框架利用集成代理模型的表达能力逼近黑箱函数,同时考虑上下文不确定性。通过采用瓦瑟斯坦球作为模糊集,EDRBO 提供计算可处理的鲁棒化获取函数,天然支持连续上下文空间。我们通过理论证明了该方法的子线性累积遗憾,其阶为 $\mathcal{O}(γ_T \sqrt{T})$,其中 $γ_T$ 表示集成模型内的最大信息增益。最后,我们进行了广泛的实验验证,结果支持理论分析,并表明 EDRBO 在性能上达到当前最优水平。

原文摘要 · Abstract (English)

We study Bayesian Optimisation (BO) in settings where the objective function is influenced by uncontrollable environmental contexts governed by an unknown probability distribution. In practice, the contextual distribution must be estimated from empirical data, a process that inherently introduces distributional mismatch, producing sub-optimal results. While Distributionally Robust Optimisation (DRO) provides a framework to mitigate these risks, existing robust BO methods frequently suffer from high computational complexity, rely on discretisation of continuous context spaces, or impose restrictive assumptions on the structure of the ambiguity set. To overcome these limitations, we propose Ensemble Distributionally Robust Bayesian Optimisation (EDRBO). Our framework leverages the expressive power of ensemble surrogate models to approximate the black-box function while simultaneously accounting for contextual uncertainty. By utilising Wasserstein ball as ambiguity sets, EDRBO provides a robustified acquisition function that remains computationally tractable and natively handles continuous context spaces. We establish a rigorous theoretical foundation for our approach by proving sublinear cumulative regret guarantees of order $\mathcal{O}(γ_T \sqrt{T})$, where $γ_T$ represents the maximum information gain within the ensemble. Finally, we provide extensive empirical evaluations that corroborate our theory and demonstrate the state-of-the-art performance of EDRBO.

贝叶斯优化鲁棒优化连续上下文集成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。