新模型同时捕捉关系数据的时空依赖,支持多任务预测。
Integrating Temporal and Structural Context in Graph Transformers for Relational Deep Learning
- 用时序子图采样扩展邻域,捕获跨时间的关系
- 在多个数据集上达到最优性能,优于现有方法
- 适合需要处理复杂关系与多任务的场景
在医疗、金融和电商等领域,关系数据的时序动态源于复杂交互(如患者与医生、用户与商品)。现有图模型多关注空间结构,将时间信息仅作为排除未来事件的约束,且通常仅支持单任务预测。为此,本文提出一种时序子图采样方法,通过检索远距离节点来增强全局上下文;并设计关系图感知器(RGP),采用基于交叉注意力的潜在瓶颈,高效融合结构与时序信息。该瓶颈将不同类型的节点和边信号映射到统一潜在空间,实现对整个关系系统的全局建模。RGP还引入灵活的交叉注意力解码器,支持在标签空间不交的多种任务间联合学习。在RelBench、SALT和CTU数据集上的实验表明,RGP达到当前最优性能,为关系深度学习提供通用且可扩展的多任务解决方案。
原文摘要 · Abstract (English)
In domains such as healthcare, finance, and e-commerce, the temporal dynamics of relational data emerge from complex interactions-such as those between patients and providers, or users and products across diverse categories. To be broadly useful, models operating on these data must integrate long-range spatial and temporal dependencies across diverse types of entities, while also supporting multiple predictive tasks. However, existing graph models for relational data primarily focus on spatial structure, treating temporal information merely as a filtering constraint to exclude future events rather than a modeling signal, and are typically designed for single-task prediction. To address these gaps, we introduce a temporal subgraph sampler that enhances global context by retrieving nodes beyond the immediate neighborhood to capture temporally relevant relationships. In addition, we propose the Relational Graph Perceiver (RGP), a graph transformer architecture for relational deep learning that leverages a cross-attention-based latent bottleneck to efficiently integrate information from both structural and temporal contexts. This latent bottleneck integrates signals from different node and edge types into a common latent space, enabling the model to build global context across the entire relational system. RGP also incorporates a flexible cross-attention decoder that supports joint learning across tasks with disjoint label spaces within a single model. Experiments on RelBench, SALT, and CTU show that RGP delivers state-of-the-art performance, offering a general and scalable solution for relational deep learning with support for diverse predictive tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。