用两种分类器平衡解决模型过/欠自信问题
Balancing Two Classifiers via A Simplex ETF Structure for Model Calibration
- 设计可调置信度模块,动态平衡两类分类器
- 在多个数据集上显著提升校准性能,准确率不变
- 适合需要可靠置信度的医疗、自动驾驶场景
近年来,深度神经网络在多个领域表现卓越,但在自动驾驶、医疗等安全关键应用中常面临模型校准问题,导致预测不可靠。现有研究虽从分类器视角改进校准,但对分类器设计的探索不足,且多数方法忽略欠自信带来的校准误差。本文提出一种新方法BalCAL,通过平衡可学习分类器与ETF分类器,解决过自信或欠自信问题。引入置信度可调模块与动态调整机制,使模型置信度更贴近真实准确率。大量实验验证表明,该方法显著提升校准性能,同时保持高预测准确率,为深度学习中的校准挑战提供新解。
原文摘要 · Abstract (English)
In recent years, deep neural networks (DNNs) have demonstrated state-of-the-art performance across various domains. However, despite their success, they often face calibration issues, particularly in safety-critical applications such as autonomous driving and healthcare, where unreliable predictions can have serious consequences. Recent research has started to improve model calibration from the view of the classifier. However, the exploration of designing the classifier to solve the model calibration problem is insufficient. Let alone most of the existing methods ignore the calibration errors arising from underconfidence. In this work, we propose a novel method by balancing learnable and ETF classifiers to solve the overconfidence or underconfidence problem for model Calibration named BalCAL. By introducing a confidence-tunable module and a dynamic adjustment method, we ensure better alignment between model confidence and its true accuracy. Extensive experimental validation shows that ours significantly improves model calibration performance while maintaining high predictive accuracy, outperforming existing techniques. This provides a novel solution to the calibration challenges commonly encountered in deep learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。