针对时间图谱中因时间划分导致的性能下降,提出IMPaCT方法提升模型泛化能力。
IMPaCT GNN: Imposing invariance with Message Passing in Chronological split Temporal Graphs
- 基于时间图结构假设,设计消息传递机制实现不变性约束
- 在ogbn-mag数据集上比现有最优方法提升3.8%准确率
- 适用于需要跨时间段泛化的图神经网络场景
本文针对时间划分下图数据域适应问题展开研究。在节点带有时间戳的归纳学习设置中,聚焦半监督节点分类任务,旨在利用历史节点标签对近期节点进行分类。节点连接的时间依赖性引发领域偏移,导致基于历史数据训练的模型在新数据上性能显著下降。鉴于该场景的实际意义,解决时间划分数据的域适应问题至关重要但研究不足。本文提出IMPaCT(Imposing invariance with Message Passing in Chronological split Temporal Graphs),基于真实时间图结构的合理假设,显式施加不变性约束。与依赖不可验证假设的传统域适应方法不同,IMPaCT充分考虑时间划分特性。方法具备严格的数学分析支撑,包括泛化误差上界推导。实验表明,IMPaCT在ogbn-mag数据集上相比当前SOTA方法提升3.8%。此外,引入时序随机块模型(TSBM)以模拟不同条件下的时间图,验证了方法对通用空间图神经网络的适用性。
原文摘要 · Abstract (English)
This paper addresses domain adaptation challenges in graph data resulting from chronological splits. In a transductive graph learning setting, where each node is associated with a timestamp, we focus on the task of Semi-Supervised Node Classification (SSNC), aiming to classify recent nodes using labels of past nodes. Temporal dependencies in node connections create domain shifts, causing significant performance degradation when applying models trained on historical data into recent data. Given the practical relevance of this scenario, addressing domain adaptation in chronological split data is crucial, yet underexplored. We propose Imposing invariance with Message Passing in Chronological split Temporal Graphs (IMPaCT), a method that imposes invariant properties based on realistic assumptions derived from temporal graph structures. Unlike traditional domain adaptation approaches which rely on unverifiable assumptions, IMPaCT explicitly accounts for the characteristics of chronological splits. The IMPaCT is further supported by rigorous mathematical analysis, including a derivation of an upper bound of the generalization error. Experimentally, IMPaCT achieves a 3.8% performance improvement over current SOTA method on the ogbn-mag graph dataset. Additionally, we introduce the Temporal Stochastic Block Model (TSBM), which replicates temporal graphs under varying conditions, demonstrating the applicability of our methods to general spatial GNNs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。