arXiv:2411.16715cs.CVcs.LG2024-11被引 3

提出新方法精准评估图像模型的置信度,区分正常、错误和异常输入。

PaRCE: Probabilistic and Reconstruction-based Competency Estimation for CNN-based Image Classification

  • 结合概率建模与重建误差,综合评估模型信心
  • 在正确分类、误判和分布外样本上表现最优
  • 可定位图像中模型熟悉或陌生区域,结果可解释

卷积神经网络(CNN)在图像分类中表现优异但常过度自信。现有方法多聚焦于量化不确定性、检测分布外(OOD)输入或识别异常区域,但缺乏对多种不确定源的综合评估。本文提出概率与重建结合的竞争力估计方法(PaRCE),在准确区分正确分类、误分类及含异常区域的分布外样本方面优于现有方法。该方法还可有效区分因视觉修改导致高、中、低预测准确率的样本。我们进一步拓展其用于异常定位任务,验证其能识别模型熟悉的图像区域与陌生区域。结果表明,该方法生成的分数具有可解释性,最可靠地捕捉了感知模型的整体置信度。

原文摘要 · Abstract (English)

Convolutional neural networks (CNNs) are extremely popular and effective for image classification tasks but tend to be overly confident in their predictions. Various works have sought to quantify uncertainty associated with these models, detect out-of-distribution (OOD) inputs, or identify anomalous regions in an image, but limited work has sought to develop a holistic approach that can accurately estimate perception model confidence across various sources of uncertainty. We develop a probabilistic and reconstruction-based competency estimation (PaRCE) method and compare it to existing approaches for uncertainty quantification and OOD detection. We find that our method can best distinguish between correctly classified, misclassified, and OOD samples with anomalous regions, as well as between samples with visual image modifications resulting in high, medium, and low prediction accuracy. We describe how to extend our approach for anomaly localization tasks and demonstrate the ability of our approach to distinguish between regions in an image that are familiar to the perception model from those that are unfamiliar. We find that our method generates interpretable scores that most reliably capture a holistic notion of perception model confidence.

模型置信度不确定性异常检测可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。