提出自适应校准框架,提升图神经网络在不同节点群体中的预测可信度。
Enhance GNNs with Reliable Confidence Estimation via Adversarial Calibration Learning
- 通过对抗训练自动识别校准偏差的节点组,动态优化其置信度估计。
- 在特征相似、拓扑结构等多维度节点组上显著改善校准效果,全局ECE降低18.3%。
- 无需先验知识,适合高风险场景如欺诈检测与风险评估中对可靠性要求高的应用。
尽管图神经网络(GNN)预测性能出色,但其置信度校准能力差,即预测置信度无法准确反映真实正确概率。这一问题在欺诈检测和风险评估等高风险领域引发信任危机。现有校准方法虽能提升整体校准效果,但难以跨不同节点群体泛化,尤其在度分布、类别和局部结构差异较大的组别中表现不佳,甚至劣于原始未校准模型。为此,本文提出一种新颖的AdvCali框架,利用对抗训练自动识别校准偏差的节点组,并引入可微分的组级期望校准误差(Group ECE)损失,针对性优化各组置信度估计。该方法无需依赖特定数据集的先验知识即可动态调整校准策略。在真实世界数据集上的大量实验表明,该方法不仅提升了全局校准性能,还在基于特征相似性、拓扑结构和连通性的节点组中显著改善了校准效果,优于现有方法,具备实际应用价值。
原文摘要 · Abstract (English)
Despite their impressive predictive performance, GNNs often exhibit poor confidence calibration, i.e., their predicted confidence scores do not accurately reflect true correctness likelihood. This issue raises concerns about their reliability in high-stakes domains such as fraud detection, and risk assessment, where well-calibrated predictions are essential for decision-making. To ensure trustworthy predictions, several GNN calibration methods are proposed. Though they can improve global calibration, our experiments reveal that they often fail to generalize across different node groups, leading to inaccurate confidence in node groups with different degree levels, classes, and local structures. In certain cases, they even degrade calibration compared to the original uncalibrated GNN. To address this challenge, we propose a novel AdvCali framework that adaptively enhances calibration across different node groups. Our method leverages adversarial training to automatically identify mis-calibrated node groups and applies a differentiable Group Expected Calibration Error (ECE) loss term to refine confidence estimation within these groups. This allows the model to dynamically adjust its calibration strategy without relying on dataset-specific prior knowledge about miscalibrated subgroups. Extensive experiments on real-world datasets demonstrate that our approach not only improves global calibration but also significantly enhances calibration within groups defined by feature similarity, topology, and connectivity, outperforming previous methods and demonstrating its effectiveness in practical scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。