提出无需消息传递的ES-MLP,统一处理同质与异质图节点分类。
Edge-Splitting MLP: Node Classification on Homophilic and Heterophilic Graphs without Message Passing
- 在图MLP损失中引入边分裂机制,学习任务相关/无关的邻接矩阵。
- 在7个数据集上性能媲美主流模型,推理速度比MPNN快2~5倍。
- 对边噪声鲁棒,适合需高效推理的异质图场景。
消息传递神经网络(MPNN)在同质图节点分类中表现优异,其成功不仅依赖同质性,更依赖同类节点邻域标签分布的一致性。基于MLP的模型如Graph-MLP不使用消息传递,通过独立损失函数整合邻域信息,具有更快的速度和更强的抗边噪声能力。但Graph-MLP仅依赖同质性,在异质图上表现不佳。为克服这一局限,本文提出ES-MLP,将来自ES-GNN的边分裂机制融入Graph-MLP的损失函数,学习基于任务相关与无关特征对的两套邻接矩阵。在七个数据集上,六种基线对比实验表明,ES-MLP在所有数据集上均达到同质与异质模型水平,且推理时不使用边信息。此外,其对多种边噪声具有鲁棒性,推理时间仅为常用MPNN的1/5至1/2。代码已开源。
原文摘要 · Abstract (English)
Message Passing Neural Networks (MPNNs) have demonstrated remarkable success in node classification on homophilic graphs. It has been shown that they do not solely rely on homophily but on neighborhood distributions of nodes, i.e., consistency of the neighborhood label distribution within the same class. MLP-based models do not use message passing, \eg Graph-MLP incorporates the neighborhood in a separate loss function. These models are faster and more robust to edge noise. Graph-MLP maps adjacent nodes closer in the embedding space but is unaware of the neighborhood pattern of the labels, i.e., relies solely on homophily. Edge Splitting GNN (ES-GNN) is a model specialized for heterophilic graphs and splits the edges into task-relevant and task-irrelevant, respectively. To mitigate the limitations of Graph-MLP on heterophilic graphs, we propose ES-MLP that combines Graph-MLP with an edge-splitting mechanism from ES-GNN. It incorporates the edge splitting into the loss of Graph-MLP to learn two separate adjacency matrices based on relevant and irrelevant feature pairs. Our experiments on seven datasets with six baselines show that ES-MLP is on par with homophilic and heterophilic models on all datasets without using edges during inference. We show that ES-MLP is robust to multiple types of edge noise during inference and that its inference time is two to five times faster than that of commonly used MPNNs. The source code is available at https://github.com/MatthiasKohn/ES-MLP.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。