通过温度调整提升贝叶斯优化在局部误差下的稳定性
Robust Bayesian Optimization via Tempered Posteriors
- 用幂次α调整后验概率,抑制过自信问题
- 理论证明调节α能降低噪声与信息增益带来的累计后悔
- 在线自适应选择α,适合采样不稳定的优化任务
贝叶斯优化通过高斯过程代理模型迭代更新并基于采集函数选择新样本点。在局部模型误设情况下,该反馈循环可能在引导后续决策的区域产生过度自信。本文提出基于温度后验的贝叶斯优化框架,将似然函数提升至幂次α∈(0,1]。针对一类由g参数化的改进型采集函数(包括概率改进PI,g=0;期望改进EI,g=1),推导了带有自适应核超参数的有限时间累计后悔界。分析表明,温度调整可减少噪声驱动的置信度和信息增益对后悔的影响,而确定性再生核希尔伯特空间项限制了过度激进的温度调整。同时揭示采集函数作用:正阶数g-EI保留典型信息增益行为,零抖动PI更具探索性且最坏情况保证较弱。基于理论发现,提出一种预序程序在线选择α:当实际预测误差超过模型暗示不确定性时降低α,校准改善则将α恢复至1。实验表明,温度调整为局部采样不稳定场景提供了实用且理论支持的代理模型稳定工具。
原文摘要 · Abstract (English)
Bayesian optimization (BO) iteratively fits a Gaussian process (GP) surrogate to accumulated evaluations and selects new queries via an acquisition function. Under local misspecification, this feedback loop can produce overconfidence precisely in the region guiding subsequent decisions. We develop a tempered GP-based BO framework that raises the likelihood to a power $α\in(0,1]$. For a generalized family of improvement acquisitions indexed by $g$, including probability of improvement (PI, $g=0$) and expected improvement (EI, $g=1$), we derive finite-time cumulative regret bounds with adaptively learned kernel hyperparameters. The analysis shows that tempering reduces the noise-driven confidence and information-gain contributions to regret, while a deterministic RKHS term prevents arbitrarily aggressive tempering from being uniformly beneficial. It also clarifies the role of the acquisition function: positive-order $g$-EI rules preserve the usual information-gain regret behavior, whereas zero-jitter PI is more exploitative and admits a weaker worst-case guarantee. Motivated by our theoretic findings, we propose a prequential procedure for selecting $α$ online: it decreases $α$ when realized prediction errors exceed model-implied uncertainty and returns $α$ toward one as calibration improves. Empirical results demonstrate that tempering provides a practical yet theoretically grounded tool for stabilizing BO surrogates under localized sampling.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。