arXiv:2602.07144cs.LGcs.AI2026-02被引 1

BONSAI让贝叶斯优化更贴近默认配置,减少无关调整。

BONSAI: Bayesian Optimization with Natural Simplicity and Interpretability

  • 基于默认配置设计,自动剪枝影响小的参数变化
  • 在保持优化效果的同时,推荐配置中非默认参数减少80%以上
  • 适合对可解释性要求高、参数敏感的工程调优场景

贝叶斯优化(BO)是高效优化黑箱函数的常用方法。但在实际应用中,参数常有精心设计的默认配置,用户仅希望在必要时才偏离。标准BO不考虑偏离默认值的问题,常将弱相关参数推向搜索空间边界,导致难以区分重要与无效调整,增加结果验证负担。本文提出BONSAI,一种感知默认配置的贝叶斯优化策略,通过剪枝低影响偏差并显式控制获取价值损失。BONSAI兼容多种采集函数(如期望改进、上置信界)。理论上证明其在特定条件下具备与原始GP-UCB相同的无后悔性质;若已知ARD长度尺度(同于GP-UCB假设),可零成本恢复关键坐标集,达到最小ℓ₀解,优于以往稀疏BO方法。在多个真实场景中,BONSAI显著减少推荐配置中非默认参数数量,性能接近标准BO,生成耗时仅标准BO的1.5倍,远低于先前稀疏方法(7–34倍)。

原文摘要 · Abstract (English)

Bayesian optimization (BO) is a popular technique for sample-efficient optimization of black-box functions. In many applications, the parameters being tuned come with a carefully engineered default configuration, and practitioners only want to deviate from this default when necessary. Standard BO, however, does not aim to minimize deviation from the default and, in practice, often pushes weakly relevant parameters to the boundary of the search space. This makes it difficult to distinguish between important and spurious changes and increases the burden of vetting recommendations when the optimization objective omits relevant operational considerations. We introduce BONSAI, a default-aware BO policy that prunes low-impact deviations from a default configuration while explicitly controlling the loss in acquisition value. BONSAI is compatible with a variety of acquisition functions, including expected improvement and upper confidence bound (GP-UCB). We theoretically bound the regret incurred by BONSAI, showing that, under certain conditions, it enjoys the same no-regret property as vanilla GP-UCB. Moreover, assuming known ARD lengthscales -- the same assumption underlying GP-UCB regret bounds -- BONSAI provably recovers the relevant-coordinate set at zero acquisition cost, yielding a method that matches the GP-UCB regret rate while recovering the minimal-$\ell_0$ solution -- a guarantee not provided by prior sparse-BO methods. Across many real-world applications, we empirically find that BONSAI substantially reduces the number of non-default parameters in recommended configurations while maintaining competitive optimization performance, with little effect on wall time -- averaging only $1.5\times$ the candidate-generation cost of standard BO, compared to $7$-$34\times$ on average for prior sparse-BO methods (IR, ER, and SEBO).

贝叶斯优化可解释性参数调优

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。