首个面向关系数据库图建模的综合评测基准,提升建模效率与效果。
RDB2G-Bench: A Comprehensive Benchmark for Automatic Graph Modeling of Relational Databases
- 构建5个真实数据库+12项任务的自动化图建模评测框架
- 不同建模方法性能差异可达10%,最佳方案显著优于通用规则
- 提供预计算数据集,加速380倍于实时训练评估
近年来,基于图的学习在关系数据库(RDB)的预测任务中展现出良好效果。这类方法需将RDB转化为图,即进行RDB-to-graph建模:表中行作为节点,外键关系作为边。然而,如何高效建模仍具挑战性——存在多种建模方式,且不同模型在预测任务上的表现差异显著。我们发现,最优建模方法相比常见启发式规则可提升高达10%的性能,但该最优方案难以识别。为推动智能建模研究,我们提出RDB2G-Bench,首个用于评估RDB-to-graph建模方法的基准框架。构建涵盖5个真实世界RDB和12项预测任务的数据集,生成约5万组图模型-性能配对,实现高效可复现的评估。得益于预计算数据集,我们在12个任务上对10种自动建模方法的评测速度比实时训练快380倍。分析揭示了影响建模有效性的关键结构模式,并给出实用建议。代码与数据已开源:https://github.com/chlehdwon/RDB2G-Bench。
原文摘要 · Abstract (English)
Recent advances have demonstrated the effectiveness of graph-based learning on relational databases (RDBs) for predictive tasks. Such approaches require transforming RDBs into graphs, a process we refer to as RDB-to-graph modeling, where rows of tables are represented as nodes and foreign-key relationships as edges. Yet, effective modeling of RDBs into graphs remains challenging. Specifically, there exist numerous ways to model RDBs into graphs, and performance on predictive tasks varies significantly depending on the chosen graph model of RDBs. In our analysis, we find that the best-performing graph model can yield up to a 10% higher performance compared to the common heuristic rule for graph modeling, which remains non-trivial to identify. To foster research on intelligent RDB-to-graph modeling, we introduce RDB2G-Bench, the first benchmark framework for evaluating such methods. We construct extensive datasets covering 5 real-world RDBs and 12 predictive tasks, resulting in around 50k graph model-performance pairs for efficient and reproducible evaluations. Thanks to our precomputed datasets, we were able to benchmark 10 automatic RDB-to-graph modeling methods on the 12 tasks about 380x faster than on-the-fly evaluation, which requires repeated GNN training. Our analysis of the datasets and benchmark results reveals key structural patterns affecting graph model effectiveness, along with practical implications for effective graph modeling. Our datasets and code are available at https://github.com/chlehdwon/RDB2G-Bench.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。