arXiv:2605.18819cs.LG2026-05

揭示伪观测批量优化有效的本质机制,统一解释多种方法的成败条件。

Efficient Conditioning Why Pseudo Observation Batch Bayesian Optimization Works When It Does not

论文配图:Efficient Conditioning Why Pseudo Observation Batch Bayesian Optimization Works When It Does not
图 1 · 摘自论文原文
  • 发现高效条件化是关键性质:数据增强后预测可闭式更新。
  • 证明高斯过程能生成分离度为l的批次点,适用于多种采集函数。
  • 提出结构多样性诊断工具,适用于模型与优化器的兼容性测试。

常谎者(CL)、克里金相信者(KB)和幻想模型广泛用于并行贝叶斯优化中的批量选择,但缺乏统一理论解释其有效性和失效条件。本文识别出‘高效条件化’为关键代理属性——即在数据增强后可闭式更新预测。我们证明高斯过程满足此要求,能生成分离度为l的明确批次点,且对任意单调非减后验不确定性采集函数(如EI、UCB、PI)均成立,汤普森采样行为类似。将CL、KB与幻想模型统一为单一条件机制,仅在谎言值分布上不同,并与局部惩罚(LP)建立定量关联,与确定性点过程(DPPs)有定性联系。为分离模型结构与优化随机性,引入结构多样性诊断(SDD),可重复用于测试代理兼容性。在Hartmann6D、Ackley 8D、Levy10D及SVM超参调优上的实验验证了所有理论预测:CL或KB隐式惩罚优于显式LP;贪婪条件化收敛性能媲美联合qEI;高效条件化扩展至多重二次RBF网络;参数化代理即使全重训也产生退化批次(如随机森林),而神经网络仅在15倍于GP条件时间下恢复多样性。鲁棒性在多个初始数据集和观测噪声下得到验证。

原文摘要 · Abstract (English)

Constant Liar (CL), Kriging Believer (KB), and fantasy models are widely used for batch selection in parallel Bayesian Optimization, yet a unified theory explaining their effectiveness and conditions under which they fail has been lacking. We identify efficient conditioning as the key surrogate property the ability to update predictions in closed form when data is augmented. We prove that Gaussian Processes satisfy this requirement, producing provably distinct batch points with separation of order l, and that this holds for any acquisition function monotonically non decreasing in posterior uncertainty (EI, UCB, PI), with qualitatively similar behavior for Thompson Sampling. We unify CL, KB, and fantasy models as instances of a single conditioning mechanism differing only in the lie value distribution, and draw quantitative connections to Local Penalization (LP) and qualitative connections to Determinantal Point Processes (DPPs). To disentangle model structure from optimizer randomness, we introduce the Structural Diversity Diagnostic (SDD), a reusable methodology for testing surrogate compatibility. Experiments on Hartmann6D, Ackley 8D, Levy10D, and SVM hyperparameter tuning validate all theoretical predictions: CL or KBs implicit penalty matches or outperforms explicit LP greedy conditioning achieves convergence on par with joint qEI efficient conditioning extends to Multiquadric RBF networks; and parametric surrogates produce degenerate batches even when fully retrained (random forests), while neural networks regain diversity only at 15x the wall clock cost of GP conditioning. Robustness is confirmed across multiple initial datasets and under observation noise.

贝叶斯优化高效条件化高斯过程批量选择

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。