解决图数据类别不平衡问题,提升少数类节点分类效果
Overcoming Class Imbalance: Unified GNN Learning with Structural and Semantic Connectivity Representations
- 融合结构与语义连接表示,扩展信息传播范围
- 在多个基准数据集上显著优于现有方法,尤其提升少数类性能
- 适合处理标签不均衡的图学习任务,如社交网络、生物网络
真实世界图数据普遍存在类别不平衡问题,多数标注节点集中在少数类别(多数类),而其他类别(少数类)仅有少量标注节点。图神经网络(GNN)在类别不平衡下性能严重下降,表现出对多数类的偏见,难以在少数类上有效泛化。这部分源于消息传递机制,导致GNN过度拟合少数类标注节点的有限邻域,阻碍判别性信息在整个图中的传播。本文提出统一图神经网络学习框架(Uni-GNN),通过语义和结构节点编码器无缝融合结构与语义连接表示。结合两类连接,Uni-GNN将节点嵌入传播扩展至非邻接的结构节点和语义相似节点,实现判别性信息在图中的高效扩散。此外,为利用图中未标注节点,设计平衡伪标签生成机制,扩充训练集中少数类的可用标注节点。实验表明,Uni-GNN在多个基准数据集上显著优于当前先进方法。
原文摘要 · Abstract (English)
Class imbalance is pervasive in real-world graph datasets, where the majority of annotated nodes belong to a small set of classes (majority classes), leaving many other classes (minority classes) with only a handful of labeled nodes. Graph Neural Networks (GNNs) suffer from significant performance degradation in the presence of class imbalance, exhibiting bias towards majority classes and struggling to generalize effectively on minority classes. This limitation stems, in part, from the message passing process, leading GNNs to overfit to the limited neighborhood of annotated nodes from minority classes and impeding the propagation of discriminative information throughout the entire graph. In this paper, we introduce a novel Unified Graph Neural Network Learning (Uni-GNN) framework to tackle class-imbalanced node classification. The proposed framework seamlessly integrates both structural and semantic connectivity representations through semantic and structural node encoders. By combining these connectivity types, Uni-GNN extends the propagation of node embeddings beyond immediate neighbors, encompassing non-adjacent structural nodes and semantically similar nodes, enabling efficient diffusion of discriminative information throughout the graph. Moreover, to harness the potential of unlabeled nodes within the graph, we employ a balanced pseudo-label generation mechanism that augments the pool of available labeled nodes from minority classes in the training set. Experimental results underscore the superior performance of our proposed Uni-GNN framework compared to state-of-the-art class-imbalanced graph learning baselines across multiple benchmark datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。