RelPrism通过多视角自生成任务提升关系型数据库预训练效果。
RelPrism: A Multi-Faceted Pre-training Framework with Self-Generated Tasks for Relational Databases

- 从属性、关系、混合三方面构建自生成伪任务池
- 在5个真实数据集上分类任务ROC-AUC提升4.15%
- 适合需要多维度信息的下游预测任务
关系型数据库(RDBs)仍是现代数据系统的核心,支持多种预测任务。现有关系深度学习方法将RDB转换为图结构,以节点表示行,边表示表间交互,再使用图模型进行表征学习。然而,有效的关系型数据库自监督预训练仍具挑战性,因任务常需跨不同视角和粒度的多维信息。例如用户流失预测依赖行为模式,而消费价值预测需结合用户-物品行为与用户固有属性。现有自监督方法通常仅基于单一视角(如节点属性或子图结构),适应性有限。为此,我们提出RelPrism,一个面向关系型数据库的多视角自监督学习框架。RelPrism从属性、关系、混合三个视角构建特征,并对每个视角进行多粒度聚类,形成对应的伪任务池。在这些任务池上进行预训练,使表征接触更广泛视角与粒度,增强下游适应能力。在5个真实数据集上的14项任务实验表明,RelPrism相比最优基线,分类任务的ROC-AUC平均提升4.15%,回归任务的MAE降低10.75%。代码已开源。
原文摘要 · Abstract (English)
Relational databases (RDBs) remain the cornerstone of modern data systems and support diverse predictive tasks. Recent relational deep learning (RDL) methods enable end-to-end prediction by converting RDBs into graphs, where rows are represented as nodes and inter-table interactions are represented as edges, and then applying graph-based models for representation learning. Despite the strong capability of RDL, effective self-supervised pre-training for RDBs remains non-trivial. RDB tasks often require multi-faceted information across different perspectives and granularities. For example, user churn classification may rely more on interaction patterns, whereas consumption value prediction requires both user-item behaviors and intrinsic user attributes for fine-grained regression. Such heterogeneous needs challenge RDB representation learning, as pre-training objectives should cover comprehensive information for downstream adaptation. However, existing SSL methods typically derive supervision from a single facet, such as node-level intrinsic attributes or subgraph-level relational structures, providing limited adaptability. To this end, we propose RelPrism, a multi-faceted self-supervised learning framework for RDBs. RelPrism constructs intrinsic, relational, and hybrid attributes from distinct perspectives, and applies multi-granularity clustering to each perspective to form corresponding pseudo-task pools. Pre-training over these pools exposes representations to broader perspectives and granularity levels, yielding a stronger basis for downstream adaptation. Experiments on 14 tasks across 5 real-world datasets show that RelPrism improves ROC-AUC by 4.15% for classification and reduces MAE by 10.75% for regression over state-of-the-art baselines. Our code is available at https://anonymous.4open.science/r/RelPrism.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。