arXiv:2505.10960cs.LGcs.AI2025-05被引 31

首个专为关系数据设计的图变压器,提升复杂结构建模能力。

Relational Graph Transformer

  • 将节点拆分为五部分进行令牌化,融合类型、时间、拓扑等信息
  • 在21个任务上超越图神经网络基线,最高提升18%
  • 适合处理大规模异构时序关系数据的研究者

关系深度学习(RDL)通过将多表关系数据表示为异构时序图,可构建先进的预测模型。然而,现有图神经网络难以捕捉关系数据中固有的复杂结构模式与长距离依赖。尽管图变压器在通用图上表现优异,应用于关系实体图仍面临挑战:(i) 传统位置编码无法推广至大规模异构图;(ii) 现有架构无法建模时序动态与模式约束;(iii) 现有分词方案会丢失关键结构信息。本文提出首个专为关系表格设计的图变压器——RelGT。RelGT采用新型多元素分词策略,将每个节点分解为特征、类型、跳数距离、时间和局部结构五个成分,无需昂贵预计算即可高效编码异质性、时序性和拓扑性。其架构结合采样子图上的局部注意力与可学习中心点的全局注意力,融合局部与全局数据库表示。在RelBench基准的21个任务中,RelGT始终匹配或超越图神经网络基线,最高提升18%,确立图变压器在关系深度学习中的强大潜力。

原文摘要 · Abstract (English)

Relational Deep Learning (RDL) is a promising approach for building state-of-the-art predictive models on multi-table relational data by representing it as a heterogeneous temporal graph. However, commonly used Graph Neural Network models suffer from fundamental limitations in capturing complex structural patterns and long-range dependencies that are inherent in relational data. While Graph Transformers have emerged as powerful alternatives to GNNs on general graphs, applying them to relational entity graphs presents unique challenges: (i) Traditional positional encodings fail to generalize to massive, heterogeneous graphs; (ii) existing architectures cannot model the temporal dynamics and schema constraints of relational data; (iii) existing tokenization schemes lose critical structural information. Here we introduce the Relational Graph Transformer (RelGT), the first graph transformer architecture designed specifically for relational tables. RelGT employs a novel multi-element tokenization strategy that decomposes each node into five components (features, type, hop distance, time, and local structure), enabling efficient encoding of heterogeneity, temporality, and topology without expensive precomputation. Our architecture combines local attention over sampled subgraphs with global attention to learnable centroids, incorporating both local and database-wide representations. Across 21 tasks from the RelBench benchmark, RelGT consistently matches or outperforms GNN baselines by up to 18%, establishing Graph Transformers as a powerful architecture for Relational Deep Learning.

图神经网络关系学习变压器多表数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。