arXiv:2602.03808cs.LGcs.AI2026-02

通过分步注意力机制提升图神经网络在标签不平衡下的分类性能

Enhancing Imbalanced Node Classification via Curriculum-Guided Feature Learning and Three-Stage Attention Network

  • 分三阶段逐步学习:先关注简单特征,再处理复杂连接,最后融合信息
  • 在8个基准数据集上,准确率、F1和AUC均优于当前最优方法
  • 适合处理社交、生物和引文网络中的标签不平衡问题

图神经网络中的标签不平衡问题表现为某些类别远多于其他类别,导致模型学习不公且对少数类表现差。为此,我们提出课程引导特征学习与三阶段注意力网络(CL3AN-GNN),其采用类似人类学习的三步注意力机制(参与、执行、嵌入)。模型首先关注结构简单的特征:(1)局部邻域模式(1跳),(2)低度节点属性,(3)通过初始GCN和GAT嵌入识别出的可区分节点对,以建立稳定早期学习基础。接着在执行阶段处理复杂要素:(1)需多步传播的连接,(2)异质节点间的边,(3)少数类边缘节点,借助可调注意力权重。最后在嵌入阶段通过迭代消息传递与课程对齐损失加权完成特征整合。我们在涵盖社交、生物和引文网络的八个Open Graph Benchmark数据集上评估该模型。实验显示,在所有数据集上,准确率、F1得分和AUC均持续优于近期最先进方法。该分步策略在不同图数据上表现稳健,相比一次性训练更快收敛,对新不平衡图泛化能力更强,并可通过梯度稳定性与注意力相关性学习曲线提供清晰解释。本工作既提供了图神经网络中课程学习的理论框架,也验证了其在应对不平衡问题上的有效性,经由指标、收敛速度与泛化测试多重验证。

原文摘要 · Abstract (English)

Imbalanced node classification in graph neural networks (GNNs) happens when some labels are much more common than others, which causes the model to learn unfairly and perform badly on the less common classes. To solve this problem, we propose a Curriculum-Guided Feature Learning and Three-Stage Attention Network (CL3AN-GNN), a learning network that uses a three-step attention system (Engage, Enact, Embed) similar to how humans learn. The model begins by engaging with structurally simpler features, defined as (1) local neighbourhood patterns (1-hop), (2) low-degree node attributes, and (3) class-separable node pairs identified via initial graph convolutional networks and graph attention networks (GCN and GAT) embeddings. This foundation enables stable early learning despite label skew. The Enact stage then addresses complicated aspects: (1) connections that require multiple steps, (2) edges that connect different types of nodes, and (3) nodes at the edges of minority classes by using adjustable attention weights. Finally, Embed consolidates these features via iterative message passing and curriculum-aligned loss weighting. We evaluate CL3AN-GNN on eight Open Graph Benchmark datasets spanning social, biological, and citation networks. Experiments show consistent improvements across all datasets in accuracy, F1-score, and AUC over recent state-of-the-art methods. The model's step-by-step method works well with different types of graph datasets, showing quicker results than training everything at once, better performance on new, imbalanced graphs, and clear explanations of each step using gradient stability and attention correlation learning curves. This work provides both a theoretically grounded framework for curriculum learning in GNNs and practical evidence of its effectiveness against imbalances, validated through metrics, convergence speeds, and generalisation tests.

图神经网络标签不平衡注意力机制课程学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。