用未知类统一优化分类与置信度校准,提升模型可靠性。
Socrates Loss: Unifying Confidence Calibration and Classification by Leveraging the Unknown

- 引入未知类作为辅助,动态调整损失函数
- 在四个数据集上实现更优的准确率-校准权衡
- 适合对置信度可靠性要求高的高风险应用
深度神经网络虽精度高,但置信度校准差,限制其在高风险场景的应用。现有校准方法存在训练稳定性与分类性能的权衡:两阶段训练虽性能强但不稳定,单损失方法稳定却分类表现弱。本文提出Socrates Loss,一种新型统一损失函数,通过引入辅助未知类,使模型预测直接影响损失和动态不确定性惩罚。该目标使模型可同时优化分类与置信度校准,避免复杂调度损失带来的不稳定性。理论证明该方法能正则化模型,防止校准偏差与过拟合。在四个基准数据集及多种架构上,实验表明该方法显著提升训练稳定性,且在准确率-校准权衡上优于现有方法,收敛速度更快。
原文摘要 · Abstract (English)
Deep neural networks, despite their high accuracy, often exhibit poor confidence calibration, limiting their reliability in high-stakes applications. Current ad-hoc confidence calibration methods attempt to fix this during training but face a fundamental trade-off: two-phase training methods achieve strong classification performance at the cost of training instability and poorer confidence calibration, while single-loss methods are stable but underperform in classification. This paper addresses and mitigates this stability-performance trade-off. We propose Socrates Loss, a novel, unified loss function that explicitly leverages uncertainty by incorporating an auxiliary unknown class, whose predictions directly influence the loss function and a dynamic uncertainty penalty. This unified objective allows the model to be optimized for both classification and confidence calibration simultaneously, without the instability of complex, scheduled losses. We provide theoretical guarantees that our method regularizes the model to prevent miscalibration and overfitting. Across four benchmark datasets and multiple architectures, our comprehensive experiments demonstrate that Socrates Loss consistently improves training stability while achieving more favorable accuracy-calibration trade-off, often converging faster than existing methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。