通过重要性评估筛选关键节点,提升图神经网络在类别不平衡下的分类效果。
NodeImport: Imbalanced Node Classification with Node Importance Assessment

- 基于平衡元集动态评估节点重要性,指导训练过程中的精细选点。
- 在多个数据集上显著提升少数类分类准确率,优于现有方法。
- 框架兼容多种数据增强技术,适合处理现实世界中的不平衡图数据。
真实场景中图的节点分类常面临类别不平衡问题,多数类主导训练导致模型偏差。传统图神经网络易过拟合多数类而忽视少数类。现有方法或按类别大小优先,或合成少数类节点,均难以有效解决该问题。本文提出NodeImport,利用平衡元集评估节点重要性:若某训练节点在无偏设置下能提升模型性能,则视为重要。通过理论推导出节点重要性公式,降低计算开销并提供直观选择阈值。据此构建新框架,筛选对无偏性能有贡献的标注、未标注及合成节点。该框架将合成与筛选过程解耦,兼容多种生成方法。同时设计高质量元集以逼近整体特征分布,保障各类别代表性。在多个数据集上测试不同GNN架构,结果表明其在缓解类别不平衡方面更具灵活性与有效性,显著提升整体性能。
原文摘要 · Abstract (English)
In real-world applications, node classification on graphs often faces the challenge of class imbalance, where majority classes dominate training, resulting in biased model performance. Traditional GNNs often struggle in such scenarios, as they tend to overfit to majority classes while underrepresenting minority classes. Existing solutions, which either prioritize nodes based on class size or synthesize new nodes for minority classes, often fall short of effectively addressing this imbalance issue. This paper introduces an approach to class-imbalanced node classification by utilizing a balanced meta-set for importance measurement, where a training node is considered significant if it enhances model performance under an unbiased setting. Our method identifies important nodes that can counteract class imbalance and utilizes them for model training, allowing for fine-grained and dynamic node selection throughout the training process. We theoretically derive a formula to directly assess node importance, reducing computational overhead and providing an intuitive threshold for node selection. Guided by this metric, we develop a novel framework that filters valuable labeled, unlabeled, and synthetic nodes that enhance model performance in an unbiased context. A key advantage of this framework is its separation of the synthetic node generation process from the filtering process, ensuring compatibility with various node generation methods. Furthermore, we introduce a strategy to construct a high-quality meta-set that closely approximates the overall feature distribution, ensuring robust representation of each class. We evaluate our framework, NodeImport, across multiple datasets using popular GNN architectures, demonstrating its superiority over existing baselines. Our results highlight the flexibility and effectiveness of the framework in mitigating class imbalance, leading to improved outcomes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。