为有序分类设计了可分解的不确定性度量方法。
Aleatoric and Epistemic Uncertainty Measures for Ordinal Classification through Binary Reduction
- 将有序分类转化为二分类问题,用熵和方差衡量不确定性。
- 在多个基准数据集上,错误检测率显著低于传统方法。
- 适合医疗、金融等需可靠决策的高风险领域使用。
有序分类问题(标签具有自然顺序)广泛存在于医疗、金融等高风险领域。准确量化不确定性,特别是将不确定性分解为固有变异(aleatoric)与知识不足(epistemic)两部分,对可靠决策至关重要。然而,现有研究主要集中在名义分类和回归任务。本文提出一种新的有序分类不确定性度量方法,基于二分类的熵与方差度量进行适配性转换。该方法有效捕捉了精确命中率与最小误差距离之间的权衡。我们在多种表格型有序基准数据集上,采用梯度提升树和多层感知机的集成模型实现近似贝叶斯推断,验证了该方法的有效性。结果表明,相比标准及标签级熵与方差度量,本方法在错误检测方面表现更优,表现为更低的误分类率与平均绝对误差。此外,该方法在分布外样本检测中也表现出良好性能。研究强调了在评估不确定性时考虑分类问题有序性的必要性。
原文摘要 · Abstract (English)
Ordinal classification problems, where labels exhibit a natural order, are prevalent in high-stakes fields such as medicine and finance. Accurate uncertainty quantification, including the decomposition into aleatoric (inherent variability) and epistemic (lack of knowledge) components, is crucial for reliable decision-making. However, existing research has primarily focused on nominal classification and regression. In this paper, we introduce a novel class of measures of aleatoric and epistemic uncertainty in ordinal classification, which is based on a suitable reduction to (entropy- and variance-based) measures for the binary case. These measures effectively capture the trade-off in ordinal classification between exact hit-rate and minimial error distances. We demonstrate the effectiveness of our approach on various tabular ordinal benchmark datasets using ensembles of gradient-boosted trees and multi-layer perceptrons for approximate Bayesian inference. Our method significantly outperforms standard and label-wise entropy and variance-based measures in error detection, as indicated by misclassification rates and mean absolute error. Additionally, the ordinal measures show competitive performance in out-of-distribution (OOD) detection. Our findings highlight the importance of considering the ordinal nature of classification problems when assessing uncertainty.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。