arXiv:2409.07014stat.MLcs.DB2024-09被引 4

提出可解释查询选择性学习的通用理论,突破传统框架局限

A Practical Theory of Generalization in Selectivity Learning

  • 用带符号测度替代概率测度,放宽理论假设
  • 证明模型在分布外数据上仍具可控误差边界
  • 适合数据库优化与模型鲁棒性研究者阅读

查询驱动的机器学习模型在查询选择性估计中展现出巨大潜力,但其理论基础仍不充分,现有最先进的理论(基于概率近似正确框架)与实际应用之间存在显著差距。本文旨在弥合理论与实践间的鸿沟:首先,证明由带符号测度诱导的选择性预测器是可学习的,从而放宽了对概率测度的依赖;更重要的是,在较弱假设下,建立了该类预测器在分布外(OOD)场景下的良好泛化误差界。这些理论进展深化了对查询驱动选择性学习在分布内与分布外泛化能力的理解,并提出了两种通用策略以提升现有模型的分布外泛化性能。实验验证表明,所提方法在预测准确率和查询延迟方面均显著提升了模型对分布外查询的泛化能力,同时保持了原有的分布内优越性能。

原文摘要 · Abstract (English)

Query-driven machine learning models have emerged as a promising estimation technique for query selectivities. Yet, surprisingly little is known about the efficacy of these techniques from a theoretical perspective, as there exist substantial gaps between practical solutions and state-of-the-art (SOTA) theory based on the Probably Approximately Correct (PAC) learning framework. In this paper, we aim to bridge the gaps between theory and practice. First, we demonstrate that selectivity predictors induced by signed measures are learnable, which relaxes the reliance on probability measures in SOTA theory. More importantly, beyond the PAC learning framework (which only allows us to characterize how the model behaves when both training and test workloads are drawn from the same distribution), we establish, under mild assumptions, that selectivity predictors from this class exhibit favorable out-of-distribution (OOD) generalization error bounds. These theoretical advances provide us with a better understanding of both the in-distribution and OOD generalization capabilities of query-driven selectivity learning, and facilitate the design of two general strategies to improve OOD generalization for existing query-driven selectivity models. We empirically verify that our techniques help query-driven selectivity models generalize significantly better to OOD queries both in terms of prediction accuracy and query latency performance, while maintaining their superior in-distribution generalization performance.

选择性学习泛化理论数据库优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。