arXiv:2502.05868cs.LG2025-02中稿 · ICASSP 2025被引 2

提升低度节点链接预测性能,通过增强嵌入向量范数实现

Norm Augmented Graph AutoEncoders for Link Prediction

  • 通过增加低度节点的自环,提升其嵌入向量范数
  • 低度节点的链接预测准确率显著提升,优于原始GAE方法
  • 无需复杂修改,可兼容现有GAE模型,适合图学习初学者

链接预测(LP)是图结构数据中的关键问题。图神经网络(GNN)在该任务中表现突出,其中图自编码器(GAE)是一种代表性方法。然而,我们实证发现,GAE在长尾度分布下性能严重受限:低度节点的预测效果明显劣于高度节点。造成这一偏差的核心原因是不同度节点的嵌入向量范数存在差异。具体而言,范数较大的嵌入更倾向于使解码器对正链接给出更高评分、对负链接给出更低评分,从而提升预测性能。基于此,我们提出一种范数增强策略,通过在训练目标中为低度节点引入额外自环,有效提升其嵌入范数。该方法简单高效,可无缝集成到现有GAE框架中,计算开销小。在多个数据集和GAE方法上的实验均验证了其优越性。

原文摘要 · Abstract (English)

Link Prediction (LP) is a crucial problem in graph-structured data. Graph Neural Networks (GNNs) have gained prominence in LP, with Graph AutoEncoders (GAEs) being a notable representation. However, our empirical findings reveal that GAEs' LP performance suffers heavily from the long-tailed node degree distribution, i.e., low-degree nodes tend to exhibit inferior LP performance compared to high-degree nodes. \emph{What causes this degree-related bias, and how can it be mitigated?} In this study, we demonstrate that the norm of node embeddings learned by GAEs exhibits variation among nodes with different degrees, underscoring its central significance in influencing the final performance of LP. Specifically, embeddings with larger norms tend to guide the decoder towards predicting higher scores for positive links and lower scores for negative links, thereby contributing to superior performance. This observation motivates us to improve GAEs' LP performance on low-degree nodes by increasing their embedding norms, which can be implemented simply yet effectively by introducing additional self-loops into the training objective for low-degree nodes. This norm augmentation strategy can be seamlessly integrated into existing GAE methods with light computational cost. Extensive experiments on various datasets and GAE methods show the superior performance of norm-augmented GAEs.

图神经网络链接预测嵌入优化自编码器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。