arXiv:2411.03744cs.LG2024-11被引 1

通过粗细粒度划分缓解标签稀疏与噪声,提升图神经网络鲁棒性。

Graph Neural Networks with Coarse- and Fine-Grained Division for Mitigating Label Sparsity and Noise

  • 用高斯混合模型按记忆效应粗分标签为干净与噪声
  • 连接无标签节点到干净标签节点,减轻标签稀疏影响
  • 基于置信度细分噪声与无标签节点,增强监督信号

图神经网络(GNN)在半监督学习中表现突出,但其性能严重依赖于干净标签。然而现实场景中标签常存在噪声且稀疏,显著降低模型效果。为此,本文提出一种新型图神经网络GNN-CFGD,通过粗细粒度划分来缓解标签稀疏与噪声问题。首先发现将无标签节点连接至干净标签节点比连接至可能带噪的标签节点更有效。基于此,引入基于记忆效应的高斯混合模型(GMM)对标签进行粗粒度划分,分离出干净与噪声标签。随后设计面向干净标签的链接机制,促进监督传播以缓解标签稀疏。进一步地,根据置信度将噪声标签和无标签节点细分为两个候选集,分别提供精细化监督与额外监督。在多个数据集上的实验表明,GNN-CFGD具有优越的性能与鲁棒性。

原文摘要 · Abstract (English)

Graph Neural Networks (GNNs) have gained considerable prominence in semi-supervised learning tasks in processing graph-structured data, primarily owing to their message-passing mechanism, which largely relies on the availability of clean labels. However, in real-world scenarios, labels on nodes of graphs are inevitably noisy and sparsely labeled, significantly degrading the performance of GNNs. Exploring robust GNNs for semi-supervised node classification in the presence of noisy and sparse labels remains a critical challenge. Therefore, we propose a novel \textbf{G}raph \textbf{N}eural \textbf{N}etwork with \textbf{C}oarse- and \textbf{F}ine-\textbf{G}rained \textbf{D}ivision for mitigating label sparsity and noise, namely GNN-CFGD. The key idea of GNN-CFGD is reducing the negative impact of noisy labels via coarse- and fine-grained division, along with graph reconstruction. Specifically, we first investigate the effectiveness of linking unlabeled nodes to cleanly labeled nodes, demonstrating that this approach is more effective in combating labeling noise than linking to potentially noisy labeled nodes. Based on this observation, we introduce a Gaussian Mixture Model (GMM) based on the memory effect to perform a coarse-grained division of the given labels into clean and noisy labels. Next, we propose a clean labels oriented link that connects unlabeled nodes to cleanly labeled nodes, aimed at mitigating label sparsity and promoting supervision propagation. Furthermore, to provide refined supervision for noisy labeled nodes and additional supervision for unlabeled nodes, we fine-grain the noisy labeled and unlabeled nodes into two candidate sets based on confidence, respectively. Extensive experiments on various datasets demonstrate the superior effectiveness and robustness of GNN-CFGD.

图神经网络标签噪声半监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。