通过中性图校准,减轻图神经网络的类别偏见问题。
NeuBM: Mitigating Model Bias in Graph Neural Networks through Neutral Input Calibration
- 用动态更新的中性图估计模型固有偏见并校正预测。
- 在严重类别不平衡下,少数类召回率显著提升,整体性能不变。
- 适合处理标注数据少、类别分布不均的图学习场景。
图神经网络在多个领域表现优异,但在类别不平衡时易出现模型偏见,导致少数类性能下降和预测不公平。本文提出NeuBM(中性偏见缓解)方法,通过动态更新的中性图来估计并校正模型偏见。通过从输入图的输出logits中减去中性图的logits,实现预测再校准,有效降低各类别间的偏见。该方法可无缝集成至现有GNN架构与训练流程,计算开销极小。在多个基准数据集上的大量实验表明,NeuBM显著提升了少数类的平衡准确率和召回率,同时保持强整体性能。其效果在严重类别不平衡和标签数据稀缺场景中尤为突出。理论分析揭示,NeuBM不仅调整最终预测,还促进网络各层学习更均衡的特征表示。
原文摘要 · Abstract (English)
Graph Neural Networks (GNNs) have shown remarkable performance across various domains, yet they often struggle with model bias, particularly in the presence of class imbalance. This bias can lead to suboptimal performance and unfair predictions, especially for underrepresented classes. We introduce NeuBM (Neutral Bias Mitigation), a novel approach to mitigate model bias in GNNs through neutral input calibration. NeuBM leverages a dynamically updated neutral graph to estimate and correct the inherent biases of the model. By subtracting the logits obtained from the neutral graph from those of the input graph, NeuBM effectively recalibrates the model's predictions, reducing bias across different classes. Our method integrates seamlessly into existing GNN architectures and training procedures, requiring minimal computational overhead. Extensive experiments on multiple benchmark datasets demonstrate that NeuBM significantly improves the balanced accuracy and recall of minority classes, while maintaining strong overall performance. The effectiveness of NeuBM is particularly pronounced in scenarios with severe class imbalance and limited labeled data, where traditional methods often struggle. We provide theoretical insights into how NeuBM achieves bias mitigation, relating it to the concept of representation balancing. Our analysis reveals that NeuBM not only adjusts the final predictions but also influences the learning of balanced feature representations throughout the network.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。