揭示图神经网络在节点与链接预测中的泛化机制
Understanding Generalization in Node and Link Prediction
- 构建统一框架分析MPNN在节点/链接预测中的泛化能力
- 实证验证理论结论,揭示图结构对泛化的影响
- 适用于归纳与直推设置,超越传统理想假设
使用消息传递图神经网络(MPNN)进行节点和链接预测在诸多科学与工业领域至关重要,催生了多样化的MPNN架构。尽管其在实际任务中表现良好,但对超出训练集的泛化能力仍缺乏理解。现有研究多集中于图级别预测,对节点与链接级别的泛化关注较少。多数工作依赖不切实际的独立同分布假设,忽略节点或链接间的相关性,且假设固定聚合方式与不现实的损失函数,忽视图结构影响。本文提出一个统一框架,用于分析MPNN在归纳与直推式节点及链接预测中的泛化特性,涵盖多种架构参数与损失函数,并量化图结构的影响。该框架还可推广至任意归纳与直推分类任务。实验结果支持理论分析,深化了对MPNN泛化能力的理解。
原文摘要 · Abstract (English)
Using message-passing graph neural networks (MPNNs) for node and link prediction is crucial in various scientific and industrial domains, which has led to the development of diverse MPNN architectures. Besides working well in practical settings, their ability to generalize beyond the training set remains poorly understood. While some studies have explored MPNNs' generalization in graph-level prediction tasks, much less attention has been given to node- and link-level predictions. Existing works often rely on unrealistic i.i.d.\@ assumptions, overlooking possible correlations between nodes or links, and assuming fixed aggregation and impractical loss functions while neglecting the influence of graph structure. In this work, we introduce a unified framework to analyze the generalization properties of MPNNs in inductive and transductive node and link prediction settings, incorporating diverse architectural parameters and loss functions and quantifying the influence of graph structure. Additionally, our proposed generalization framework can be applied beyond graphs to any classification task under the inductive or transductive setting. Our empirical study supports our theoretical insights, deepening our understanding of MPNNs' generalization capabilities in these tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。