GNN难以学习共同邻居数,但可借助节点嵌入提升链接预测性能。
Can GNNs Learn Link Heuristics? A Concise Review and Evaluation of Link Prediction Methods
- GNN的邻域聚合机制限制了对共同邻居数量的学习
- 可训练节点嵌入显著提升性能,图越密提升越明显
- 适合关注GNN在链接预测中局限性的研究者参考
本文探讨图神经网络(GNNs)在链接预测中学习各类信息的能力,并简要回顾现有方法。分析表明,由于邻域聚合采用基于集合的池化机制,GNN难以有效学习两节点间共同邻居数量的结构信息。大量实验显示,可训练的节点嵌入能显著提升基于GNN的链接预测模型性能,且图越密集,性能提升越明显。这归因于节点嵌入能编码连接状态:在稠密图中,每个节点有更多机会参与其他节点的邻域聚合,从而将更多链接样本的状态编码到自身嵌入中,获得更优表示。研究结果揭示了现有链接预测方法的局限性,为未来设计更鲁棒算法提供重要指导。
原文摘要 · Abstract (English)
This paper explores the ability of Graph Neural Networks (GNNs) in learning various forms of information for link prediction, alongside a brief review of existing link prediction methods. Our analysis reveals that GNNs cannot effectively learn structural information related to the number of common neighbors between two nodes, primarily due to the nature of set-based pooling of the neighborhood aggregation scheme. Also, our extensive experiments indicate that trainable node embeddings can improve the performance of GNN-based link prediction models. Importantly, we observe that the denser the graph, the greater such the improvement. We attribute this to the characteristics of node embeddings, where the link state of each link sample could be encoded into the embeddings of nodes that are involved in the neighborhood aggregation of the two nodes in that link sample. In denser graphs, every node could have more opportunities to attend the neighborhood aggregation of other nodes and encode states of more link samples to its embedding, thus learning better node embeddings for link prediction. Lastly, we demonstrate that the insights gained from our research carry important implications in identifying the limitations of existing link prediction methods, which could guide the future development of more robust algorithms.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。