提出PNS方法解决图节点分类中的随机性导致的性能波动问题
Pure Node Selection for Imbalanced Graph Node Classification
- 设计可插拔的纯节点采样模块,直接在节点合成阶段缓解随机性异常连接问题
- 在多个基准数据集上验证,消除不良随机种子影响并优于基线模型
- 适合关注图神经网络稳定性与不平衡数据处理的研究者
类别不平衡指数据集中各类别样本数量分布不均,某些类别严重缺失。该问题在图结构数据中同样普遍。主流图神经网络(GNN)通常基于类别平衡假设,忽略不平衡问题。我们发现一种名为随机性异常连接问题(RACP)的现象:现有模型受随机种子影响显著,导致性能下降。为消除算法中随机因素的影响,我们提出纯节点采样(PNS)方法,在节点合成阶段解决RACP。不同于以往仅处理数量或拓扑不平衡的方法,PNS是直接作用于节点合成的即插即用模块,同时缓解因邻居分布异常引发的性能下降。通过一系列实验,我们识别出受随机种子影响的关键因素。结果表明,所提方法有效且稳定,不仅消除了不利随机种子的影响,还在不同基准数据集与多种GNN骨干网络下均超越基线。代码与数据见:https://github.com/flzeng1/PNS。
原文摘要 · Abstract (English)
The problem of class imbalance refers to an uneven distribution of quantity among classes in a dataset, where some classes are significantly underrepresented compared to others. Class imbalance is also prevalent in graph-structured data. Graph neural networks (GNNs) are typically based on the assumption of class balance, often overlooking the issue of class imbalance. In our investigation, we identified a problem, which we term the Randomness Anomalous Connectivity Problem (RACP), where certain off-the-shelf models are affected by random seeds, leading to a significant performance degradation. To eliminate the influence of random factors in algorithms, we proposed PNS (Pure Node Sampling) to address the RACP in the node synthesis stage. Unlike existing approaches that design specialized algorithms to handle either quantity imbalance or topological imbalance, PNS is a novel plug-and-play module that operates directly during node synthesis to mitigate RACP. Moreover, PNS also alleviates performance degradation caused by abnormal distribution of node neighbors. We conduct a series of experiments to identify what factors are influenced by random seeds. Experimental results demonstrate the effectiveness and stability of our method, which not only eliminates the effect of unfavorable random seeds but also outperforms the baseline across various benchmark datasets with different GNN backbones. Data and code are available at https://github.com/flzeng1/PNS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。