提出首个无需分布假设的数据库自动调优框架,显著提升调优效率与效果。
Centrum: Model-based Database Auto-tuning with Minimal Distributional Assumptions
- 采用分阶段梯度提升集成学习实现无分布点与区间估计
- 引入广义SGBE自适应共形预测,实现无分布不确定性估计
- 首次融合梯度提升与共形推理,适合追求高精度调优的系统研究者
基于高斯过程的贝叶斯优化(GP-BO)是主流数据库自动调优方法,但近期研究表明,基于随机森林的SMAC方法在性能上显著优于GP-BO。我们发现,实际数据库性能建模中,GP-BO的基本假设普遍被违反;而树集成贝叶斯优化(如SMAC)可规避这些假设陷阱,提升调优效率与效果。然而,现有树集成方法仍依赖非现实的不确定性分布假设,限制了进一步发展。同时,先进的梯度提升技术尚未应用于数据库调优。为此,我们提出新框架Centrum:通过两阶段随机梯度提升集成,实现无分布的点与区间估计;并采用广义SGBE-估计的局部自适应共形预测,实现无分布不确定性估计与获取函数。据我们所知,Centrum是首个实现全分布自由的自动调优器,也是首个将梯度提升与共形推理无缝融合于贝叶斯优化中的系统。在两个数据库和三个工作负载上的物理与仿真实验表明,Centrum超越21种现有最先进方法。
原文摘要 · Abstract (English)
Gaussian-Process-based Bayesian optimization (GP-BO), is a prevailing model-based framework for DBMS auto-tuning. However, recent work shows GP-BO-based DBMS auto-tuners significantly outperformed auto-tuners based on SMAC, which features random forest surrogate models; such results motivate us to rethink and investigate the limitations of GP-BO in auto-tuner design. We find the fundamental assumptions of GP-BO are widely violated when modeling and optimizing DBMS performance, while tree-ensemble-BOs (e.g., SMAC) can avoid the assumption pitfalls and deliver improved tuning efficiency and effectiveness. Moreover, we argue that existing tree-ensemble-BOs restrict further advancement in DBMS auto-tuning. First, existing tree-ensemble-BOs can only achieve distribution-free point estimates, but still impose unrealistic distributional assumptions on uncertainty estimates, compromising surrogate modeling and distort the acquisition function. Second, recent advances in gradient boosting, which can further enhance surrogate modeling against vanilla GP and random forest counterparts, have rarely been applied in optimizing DBMS auto-tuners. To address these issues, we propose a novel model-based DBMS auto-tuner, Centrum. Centrum improves distribution-free point and interval estimation in surrogate modeling with a two-phase learning procedure of stochastic gradient boosting ensembles. Moreover, Centrum adopts a generalized SGBE-estimated locally-adaptive conformal prediction to facilitate a distribution-free uncertainty estimation and acquisition function. To our knowledge, Centrum is the first auto-tuner to realize distribution-freeness, enhancing BO's practicality in DBMS auto-tuning, and the first to seamlessly fuse gradient boosting ensembles and conformal inference in BO. Extensive physical and simulation experiments on two DBMSs and three workloads show Centrum outperforms 21 SOTA methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。