构建11个大型关系数据集,推动关系型深度学习评估标准化
RelBench v2: A Large-Scale Benchmark and Repository for Relational Data
- 新增4个大规模真实数据集,总数据量超2200万行,覆盖学术、企业、消费与医疗场景
- 引入自动补全任务,要求模型在时间约束下预测表中缺失字段值,拓展传统预测任务边界
- 集成多个外部基准,支持跨数据集统一评估,适合研究关系型基础模型的学者
关系型深度学习(RDL)通过建模多张关联表格中的实体及其关系,直接在关系型数据库上进行学习,已成为强大范式。随着该范式向大模型和关系型基础模型发展,可扩展且真实的评估基准至关重要。本文推出RelBench v2,对RDL基准进行重大升级:新增涵盖学术出版、企业资源规划、消费者平台及临床记录的4个大规模关系数据集,使基准总量达11个,包含超过2200万行数据分布在29张表中。我们引入自动补全任务——一种新的预测目标,要求模型在遵守时间约束的前提下,直接推断关系表中缺失的属性值,突破了传统基于SQL查询的预测任务。此外,RelBench v2还扩展至外部基准:将时序图基准(Temporal Graph Benchmark)中的事件流转换为关系模式,实现统一的关系-时序评估;接入ReDeLEx,提供对70多个真实世界数据库的统一访问,适用于预训练;整合4DBInfer数据集与任务,增强多表预测覆盖范围。实验表明,RDL模型在自动补全、预测与推荐任务中均显著优于单表基线,凸显显式建模关系结构的重要性。
原文摘要 · Abstract (English)
Relational deep learning (RDL) has emerged as a powerful paradigm for learning directly on relational databases by modeling entities and their relationships across multiple interconnected tables. As this paradigm evolves toward larger models and relational foundation models, scalable and realistic benchmarks are essential for enabling systematic evaluation and progress. In this paper, we introduce RelBench v2, a major expansion of the RelBench benchmark for RDL. RelBench v2 adds four large-scale relational datasets spanning scholarly publications, enterprise resource planning, consumer platforms, and clinical records, increasing the benchmark to 11 datasets comprising over 22 million rows across 29 tables. We further introduce autocomplete tasks, a new class of predictive objectives that require models to infer missing attribute values directly within relational tables while respecting temporal constraints, expanding beyond traditional forecasting tasks constructed via SQL queries. In addition, RelBench v2 expands beyond its native datasets by integrating external benchmarks and evaluation frameworks: we translate event streams from the Temporal Graph Benchmark into relational schemas for unified relational-temporal evaluation, interface with ReDeLEx to provide uniform access to 70+ real-world databases suitable for pretraining, and incorporate 4DBInfer datasets and tasks to broaden multi-table prediction coverage. Experimental results demonstrate that RDL models consistently outperform single-table baselines across autocomplete, forecasting, and recommendation tasks, highlighting the importance of modeling relational structure explicitly.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。