arXiv:2605.23249cs.LGcs.AI2026-05

提升深度模型可靠性,同时优化置信度准确性和区分度。

Enhancing Deep Neural Network Reliability with Refinement and Calibration

论文配图:Enhancing Deep Neural Network Reliability with Refinement and Calibration
图 1 · 摘自论文原文
  • 提出新损失函数,通过对比学习显式增强模型区分能力。
  • 在不平衡数据上实现58.81%准确率、95.67%精炼度和0.08%ECE。
  • 适合关注模型可信置信度的工业应用与安全关键场景。

尽管深度神经网络(DNN)具备高预测精度,其置信度估计往往不可靠,可能损害用户对其决策的信任。这促使研究者关注校准模型——校准衡量模型预测置信度与实际正确概率的一致性。然而,许多后处理技术仅模仿训练时的不确定性,并未真正提升模型理解能力。统计学建议模型应既校准又精炼:精炼指对正确与错误预测赋予显著不同的置信度,也称锐度。我们发现现有校准方法常以牺牲精炼度为代价。为此,本文提出:(1) 一种显式促进精炼的新损失函数,可通过监督对比学习优化;(2) 统一训练框架 RefCal,联合优化校准、精炼与准确率,以提升 DNN 可靠性。在具有10%类别不平衡的 CIFAR-100-LT 数据集上,RefCal 达到 (准确率, 精炼度, ECE) = (58.81, 95.67, 0.08),显著优于广泛使用的正确性排序损失(46.27, 93.7, 0.22)。

原文摘要 · Abstract (English)

Although deep neural networks (DNNs) achieve high predictive accuracy, their confidence estimates are often unreliable, potentially compromising user trust in their decisions. This has motivated research on calibrated models, where calibration measures how well a model's predicted confidence aligns with the empirical probability of correctness. However, calibration metrics can often be improved through post-processing techniques that merely mimic training-time uncertainty without genuinely improving the model's understanding. For this reason, statisticians recommend that models be not only calibrated but also refined. Intuitively, a model is considered more refined if it assigns significantly different confidence scores to correct and incorrect predictions, a property also referred to as sharpness. We observe that many existing calibration methods improve calibration at the cost of reduced refinement. To address this limitation, we propose: (1) a novel loss function that explicitly promotes refinement and can be optimized through supervised contrastive learning; and (2) a unified training framework, RefCal, that jointly optimizes calibration, refinement, and accuracy to improve DNN reliability. On the CIFAR-100-LT dataset with 10 percent class imbalance, RefCal achieves (accuracy, refinement, ECE) of (58.81, 95.67, 0.08), substantially outperforming the widely used Correctness Ranking Loss, which achieves (46.27, 93.7, 0.22).

模型校准置信度精炼度DNN可靠性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。