arXiv:2411.11020cs.LGcs.SI2024-11被引 1

提出轻量级GNN框架,用多标签集成提升抗噪声能力。

Training a Label-Noise-Resistant GNN with Reduced Complexity

  • 将噪声标签任务转为多标签集成,避免复杂可靠性计算
  • 在六个数据集上表现优异,百万级边图仍高效可扩展
  • 通过高低概率标签对冲,有效抑制噪声干扰

图神经网络(GNN)广泛用于半监督节点分类,但标签噪声会严重误导训练。主流方法将带噪声的节点分类(NCLN)视为可靠标签任务,常引入基于邻居相似性的二次复杂度计算以评估标签可靠性。本文提出低复杂度的标签集成图神经网络(LEGNN),将NCLN重构为标签集成任务,通过聚合多个高置信度标签而非构建单一可靠标签,规避高复杂度可靠性评估。LEGNN采用两阶段策略:首先对每个节点随机掩码邻居,收集预测标签形成高置信度标签集,降低错误邻居影响并增强标签多样性;其次采用部分标签学习策略聚合高置信度标签信息进行训练,并对称收集低置信度标签集以抵消高置信度标签可能带来的噪声。六组数据集实验表明,LEGNN在保证效率的同时实现优异性能,在超过十万节点、百万边的数据集上仍具良好可扩展性。

原文摘要 · Abstract (English)

Graph Neural Networks (GNNs) have been widely employed for semi-supervised node classification tasks on graphs. However, the performance of GNNs is significantly affected by label noise, that is, a small amount of incorrectly labeled nodes can substantially misguide model training. Mainstream solutions define node classification with label noise (NCLN) as a reliable labeling task, often introducing node similarity with quadratic computational complexity to more accurately assess label reliability. To this end, in this paper, we introduce the Label Ensemble Graph Neural Network (LEGNN), a lower complexity method for robust GNNs training against label noise. LEGNN reframes NCLN as a label ensemble task, gathering informative multiple labels instead of constructing a single reliable label, avoiding high-complexity computations for reliability assessment. Specifically, LEGNN conducts a two-step process: bootstrapping neighboring contexts and robust learning with gathered multiple labels. In the former step, we apply random neighbor masks for each node and gather the predicted labels as a high-probability label set. This mitigates the impact of inaccurately labeled neighbors and diversifies the label set. In the latter step, we utilize a partial label learning based strategy to aggregate the high-probability label information for model training. Additionally, we symmetrically gather a low-probability label set to counteract potential noise from the bootstrapped high-probability label set. Extensive experiments on six datasets demonstrate that LEGNN achieves outstanding performance while ensuring efficiency. Moreover, it exhibits good scalability on dataset with over one hundred thousand nodes and one million edges.

图神经网络标签噪声多标签集成高效训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。