用机器学习优化R树,提速查询并支持动态更新
Tradeoffs in Processing Queries and Supporting Updates over an ML-Enhanced R-tree
- 用神经网络模型预测查询路径,避开无效分支
- 高重叠场景下查询速度提升5.4倍,平均召回率达99%
- 设计专用损失函数和动态更新策略,适合实时数据系统
机器学习已被成功应用于设计一维和多维空间的各类学习型数据库索引结构。本文聚焦于广泛用于多维数据索引的R树结构,将其与机器学习模型结合,形成AI+R-tree这一增强型索引。该结构通过引入机器学习模型,显著提升传统磁盘式R树在查询处理中的性能,尤其能有效避免在高重叠矩形节点中遍历无结果的分支。本文实证研究了动态查询负载与更新操作之间的权衡关系,考察了不同机器学习模型对查询性能的影响,并提出一种针对AI+R-tree查询需求定制的神经网络损失函数。同时,探讨了支持动态插入、更新和删除的各种策略,旨在实现可变的AI+R-tree。在真实数据集上的实验表明,对于高重叠范围查询,AI+R-tree相比传统R树查询性能最高可提升5.4倍,平均查询召回率可达99%。
原文摘要 · Abstract (English)
Machine Learning (ML) techniques have been successfully applied to design various learned database index structures for both the one- and multi-dimensional spaces. Particularly, a class of traditional multi-dimensional indexes has been augmented with ML models to design ML-enhanced variants of their traditional counterparts. This paper focuses on the R-tree multi-dimensional index structure as it is widely used for indexing multi-dimensional data. The R-tree has been augmented with machine learning models to enhance the R-tree performance. The AI+R-tree is an ML-enhanced R-tree index structure that augments a traditional disk-based R-tree with an ML model to enhance the R-tree's query processing performance, mainly, to avoid navigating the overlapping branches of the R-tree that do not yield query results, e.g., in the presence of high-overlap among the rectangles of the R-tree nodes. We investigate the empirical tradeoffs in processing dynamic query workloads and in supporting updates over the AI+R-tree. Particularly, we investigate the impact of the choice of ML models over the AI+R-tree query processing performance. Moreover, we present a case study of designing a custom loss function for a neural network model tailored to the query processing requirements of the AI+R-tree. Furthermore, we present the design tradeoffs for adopting various strategies for supporting dynamic inserts, updates, and deletes with the vision of realizing a mutable AI+R-tree. Experiments on real datasets demonstrate that the AI+R-tree can enhance the query processing performance of a traditional R-tree for high-overlap range queries by up to 5.4X while achieving up to 99% average query recall.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。