轻量级中间件MICRO实现跨模型图关系查询高效执行
MICRO: A Lightweight Middleware for Optimizing Cross-store Cross-model Graph-Relation Joins [Technical Report]
- 提出统一代数与学习排序优化器CMLero,无需精确成本估算
- 真实数据集上14个查询提速超100倍,最高达100倍以上
- 适合需要跨图/关系数据库协同分析的系统开发者
现代数据应用日益涉及异构数据在不同模型和异构数据库引擎中的管理,常以独立部署形式存在。现有研究对联邦环境下的跨模型查询处理关注较少。本文通过三项工作填补该空白:(1)形式化定义图存储与关系存储间的跨模型连接查询,提出统一代数;(2)构建一个真实世界基准和四个半合成基准用于评估此类查询;(3)提出轻量级中间件MICRO以实现高效查询执行。MICRO核心为CMLero,一种基于学习排序的查询优化器,可在无需精确成本估计的情况下选择高效执行计划。通过避免将所有数据物化或转换为单一模型(因第三方数据控制或成本限制通常不可行),MICRO支持原生跨异构系统查询。在基准测试中,MICRO在全测试集上的总运行时间相比最先进联邦关系系统XDB最高提升2.1倍。在真实世界基准的93个查询中,14个查询提速超过100倍,其中4个超过100倍;但有4个查询出现超过5秒的延迟,表明仍有优化空间。进一步对比显示,CMLero始终优于基于规则和回归的优化器,凸显学习排序在复杂跨模型优化中的优势。
原文摘要 · Abstract (English)
Modern data applications increasingly involve heterogeneous data managed in different models and stored across disparate database engines, often deployed as separate installs. Limited research has addressed cross-model query processing in federated environments. This paper takes a step toward bridging this gap by: (1) formally defining a class of cross-model join queries between a graph store and a relational store by proposing a unified algebra; (2) introducing one real-world benchmark and four semi-synthetic benchmarks to evaluate such queries; and (3) proposing a lightweight middleware, MICRO, for efficient query execution. At the core of MICRO is CMLero, a learning-to-rank-based query optimizer that selects efficient execution plans without requiring exact cost estimation. By avoiding the need to materialize or convert all data into a single model, which is often infeasible due to third-party data control or cost, MICRO enables native querying across heterogeneous systems. Experimental results on the benchmark workloads demonstrate that MICRO outperforms the state-of-the-art federated relational system XDB by up to 2.1x in total runtime across the full test set. On the 93 test queries of real-world benchmark, 14 queries achieve over 100 speedup, including 4 queries with more than 100x speedup; however, 4 queries experienced slowdowns of over 5 seconds, highlighting opportunities for future improvement of MICRO. Further comparisons show that CMLero consistently outperforms rule-based and regression-based optimizers, highlighting the advantage of learning-to-rank in complex cross-model optimization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。