arXiv:2411.06243cs.DBcs.LG2024-11ICLR被引 5

首次为学习型数据库操作提供误差保证理论,解决可靠性瓶颈。

Towards Establishing Guaranteed Error for Learned Database Operations

  • 提出索引、基数估计、范围求和三类操作的模型规模下界
  • 给出平均与最坏情况误差下的模型大小约束条件
  • 为真实系统采用学习模型提供理论依据,适合数据库研究者

机器学习模型在索引、基数估计和范围求和等基础数据管理操作中表现出显著优于传统方法的性能。然而,由于缺乏最坏情况误差保证,实际系统仍常采用效率较低的传统方法。本文首次对学习型方法的误差保证进行理论分析,明确了在索引、基数估计和范围求和三种核心操作中实现给定精度所需的最小模型规模下界。结果给出了在特定平均误差与最坏情况误差条件下,模型大小随数据规模变化的理论约束,为学习模型在真实系统中的可靠部署提供首个理论指导。本研究推动了学习模型在数据库系统中的广泛应用。

原文摘要 · Abstract (English)

Machine learning models have demonstrated substantial performance enhancements over non-learned alternatives in various fundamental data management operations, including indexing (locating items in an array), cardinality estimation (estimating the number of matching records in a database), and range-sum estimation (estimating aggregate attribute values for query-matched records). However, real-world systems frequently favor less efficient non-learned methods due to their ability to offer (worst-case) error guarantees - an aspect where learned approaches often fall short. The primary objective of these guarantees is to ensure system reliability, ensuring that the chosen approach consistently delivers the desired level of accuracy across all databases. In this paper, we embark on the first theoretical study of such guarantees for learned methods, presenting the necessary conditions for such guarantees to hold when using machine learning to perform indexing, cardinality estimation and range-sum estimation. Specifically, we present the first known lower bounds on the model size required to achieve the desired accuracy for these three key database operations. Our results bound the required model size for given average and worst-case errors in performing database operations, serving as the first theoretical guidelines governing how model size must change based on data size to be able to guarantee an accuracy level. More broadly, our established guarantees pave the way for the broader adoption and integration of learned models into real-world systems.

数据库机器学习误差保证理论分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。