通过利用未标注节点提升图神经网络在数据不平衡下的分类性能。
IceBerg: Debiased Self-Training for Class-Imbalanced Node Classification
- 设计双平衡机制缓解自训练中的马太效应与标签分布偏移。
- 分离传播与变换操作,增强长距离信息传递能力,改善少样本问题。
- 仅需少量代码修改即可显著提升现有模型表现,适合实际部署。
图神经网络(GNN)在处理非欧几里得图结构数据方面取得显著成功,并广泛应用于现实场景。然而,在类别不平衡的训练集下其性能常受损害。现有研究多从监督学习角度分析该问题,却未充分利用半监督场景中大量未标注节点。本文指出,监督信号只是冰山一角,大量未标注节点尚未被有效利用。为此,提出IceBerg——一种去偏自训练框架,同时应对类别不平衡与少样本挑战。首先,提出双平衡机制,可显著提升现有基线性能,且仅需少量代码作为即插即用模块;其次,解耦GNN的传播与变换操作,增强弱监督信号的长距离传播能力,以缓解少样本问题。实验表明,利用未标注节点能显著提升GNN在类别不平衡与少样本场景下的表现,微小而精准的改动即可带来显著性能提升。在基准数据集上的系统实验显示,IceBerg优于现有类别不平衡节点分类方法,且在少样本节点分类任务中达到最新水平。代码已开源:https://github.com/ZhixunLEE/IceBerg。
原文摘要 · Abstract (English)
Graph Neural Networks (GNNs) have achieved great success in dealing with non-Euclidean graph-structured data and have been widely deployed in many real-world applications. However, their effectiveness is often jeopardized under class-imbalanced training sets. Most existing studies have analyzed class-imbalanced node classification from a supervised learning perspective, but they do not fully utilize the large number of unlabeled nodes in semi-supervised scenarios. We claim that the supervised signal is just the tip of the iceberg and a large number of unlabeled nodes have not yet been effectively utilized. In this work, we propose IceBerg, a debiased self-training framework to address the class-imbalanced and few-shot challenges for GNNs at the same time. Specifically, to figure out the Matthew effect and label distribution shift in self-training, we propose Double Balancing, which can largely improve the performance of existing baselines with just a few lines of code as a simple plug-and-play module. Secondly, to enhance the long-range propagation capability of GNNs, we disentangle the propagation and transformation operations of GNNs. Therefore, the weak supervision signals can propagate more effectively to address the few-shot issue. In summary, we find that leveraging unlabeled nodes can significantly enhance the performance of GNNs in class-imbalanced and few-shot scenarios, and even small, surgical modifications can lead to substantial performance improvements. Systematic experiments on benchmark datasets show that our method can deliver considerable performance gain over existing class-imbalanced node classification baselines. Additionally, due to IceBerg's outstanding ability to leverage unsupervised signals, it also achieves state-of-the-art results in few-shot node classification scenarios. The code of IceBerg is available at: https://github.com/ZhixunLEE/IceBerg.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。