arXiv:2411.01981cs.CV2024-11NeurIPS被引 10

通过衡量样本典型性,缓解深度模型误判时的过度自信问题。

Typicalness-Aware Learning for Failure Detection

  • 引入典型性度量,动态调整异常样本的输出强度。
  • 在CIFAR100上比当前最优方法提升超5%的失效检测性能(AURC)。
  • 适合对可靠性要求高的关键系统,如医疗或自动驾驶。

深度神经网络常因错误预测伴随高置信度而出现过度自信问题,限制其在关键系统中的应用。本文提出典型的感知学习(TAL)方法,解决此问题。我们观察到,使用交叉熵损失时,模型通过增大logit幅值或优化方向来对齐标签。然而对于非典型样本,图像内容与标签可能存在不一致,导致模型在这些样本上过拟合,进而引发过度自信。为此,我们设计了一种量化每个样本典型性的度量,并在训练中动态调节logit幅值。该方法使模型能充分拟合非典型样本的同时保持可靠的logit方向,有效缓解过度自信问题。TAL在多个基准数据集上进行了广泛评估,结果表明其优于现有方法。尤其在CIFAR100上,其面积-风险覆盖曲线(AURC)相比当前最优方法提升超过5%。代码已开源:https://github.com/liuyijungoon/TAL。

原文摘要 · Abstract (English)

Deep neural networks (DNNs) often suffer from the overconfidence issue, where incorrect predictions are made with high confidence scores, hindering the applications in critical systems. In this paper, we propose a novel approach called Typicalness-Aware Learning (TAL) to address this issue and improve failure detection performance. We observe that, with the cross-entropy loss, model predictions are optimized to align with the corresponding labels via increasing logit magnitude or refining logit direction. However, regarding atypical samples, the image content and their labels may exhibit disparities. This discrepancy can lead to overfitting on atypical samples, ultimately resulting in the overconfidence issue that we aim to address. To tackle the problem, we have devised a metric that quantifies the typicalness of each sample, enabling the dynamic adjustment of the logit magnitude during the training process. By allowing atypical samples to be adequately fitted while preserving reliable logit direction, the problem of overconfidence can be mitigated. TAL has been extensively evaluated on benchmark datasets, and the results demonstrate its superiority over existing failure detection methods. Specifically, TAL achieves a more than 5% improvement on CIFAR100 in terms of the Area Under the Risk-Coverage Curve (AURC) compared to the state-of-the-art. Code is available at https://github.com/liuyijungoon/TAL.

失败检测过自信典型性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。