arXiv:2412.14223cs.LG2024-12AAAI被引 1

通过分组校准提升图神经网络预测不确定性精度

Towards Precise Prediction Uncertainty in GNNs: Refining GNNs with Topology-grouping Strategy

  • 按邻居相似性和自身置信度对节点分组,实现细粒度校准
  • 在多个数据集上比未校准模型误差降低13.79%
  • 适合关注模型可信度评估的图学习研究者

图神经网络(GNN)的预测校准近年受到重视,邻域预测相似性被视为关键因素。现有方法将邻域相似性融入节点级温度缩放,但我们的分析发现该假设不普遍成立:即使邻域相似性相近,不同置信度的节点仍可能有显著校准误差。这表明统一校准策略效果不佳。为此,我们提出Simi-Mailbox,根据节点的邻域相似性与自身置信度进行分组,不依赖邻接关系。该方法采用组内特异性温度缩放,每组温度针对其特定校准偏差优化,而非依赖邻域相似性的统一趋势。大量实验表明,Simi-Mailbox在多种数据集和GNN架构上均有效,相比未校准的GNN预测,误差最高可降低13.79%。

原文摘要 · Abstract (English)

Recent advancements in graph neural networks (GNNs) have highlighted the critical need of calibrating model predictions, with neighborhood prediction similarity recognized as a pivotal component. Existing studies suggest that nodes with analogous neighborhood prediction similarity often exhibit similar calibration characteristics. Building on this insight, recent approaches incorporate neighborhood similarity into node-wise temperature scaling techniques. However, our analysis reveals that this assumption does not hold universally. Calibration errors can differ significantly even among nodes with comparable neighborhood similarity, depending on their confidence levels. This necessitates a re-evaluation of existing GNN calibration methods, as a single, unified approach may lead to sub-optimal calibration. In response, we introduce **Simi-Mailbox**, a novel approach that categorizes nodes by both neighborhood similarity and their own confidence, irrespective of proximity or connectivity. Our method allows fine-grained calibration by employing *group-specific* temperature scaling, with each temperature tailored to address the specific miscalibration level of affiliated nodes, rather than adhering to a uniform trend based on neighborhood similarity. Extensive experiments demonstrate the effectiveness of our **Simi-Mailbox** across diverse datasets on different GNN architectures, achieving up to 13.79\% error reduction compared to uncalibrated GNN predictions.

图神经网络不确定性估计校准

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。