arXiv:2508.13288cs.LGcs.AI2025-08被引 2

将类别层次结构融入置信预测,提升分类不确定性量化效果

Hierarchical Conformal Classification

  • 基于类别层级构建分层预测集,融合语义关系优化输出
  • 在音频、图像、文本三类数据上验证性能,显著优于传统方法
  • 用户研究证实分层预测更易理解,适合需可解释性的场景

置信预测(CP)是一种强大的机器学习不确定性量化框架,能在有限样本下提供可靠的预测并保证覆盖率。应用于分类时,标准CP生成一个包含真实标签的预测集合,且不依赖于具体分类器。然而,传统方法将类别视为扁平无结构,忽略了类别间的语义关系或层级结构。本文提出分层置信分类(HCC),将类别层次结构融入预测集的结构与语义中。我们将HCC建模为带约束的优化问题,其解可生成不同层级节点构成的预测集,同时保持覆盖率。针对问题的组合复杂性,我们证明只需考虑一个更小且结构良好的候选解子集即可确保覆盖率与最优性。在包含音频、图像和文本的三个新基准上的实证评估显示本方法优势,用户研究表明标注者显著偏好分层预测集。

原文摘要 · Abstract (English)

Conformal prediction (CP) is a powerful framework for quantifying uncertainty in machine learning models, offering reliable predictions with finite-sample coverage guarantees. When applied to classification, CP produces a prediction set of possible labels that is guaranteed to contain the true label with high probability, regardless of the underlying classifier. However, standard CP treats classes as flat and unstructured, ignoring domain knowledge such as semantic relationships or hierarchical structure among class labels. This paper presents hierarchical conformal classification (HCC), an extension of CP that incorporates class hierarchies into both the structure and semantics of prediction sets. We formulate HCC as a constrained optimization problem whose solutions yield prediction sets composed of nodes at different levels of the hierarchy, while maintaining coverage guarantees. To address the combinatorial nature of the problem, we formally show that a much smaller, well-structured subset of candidate solutions suffices to ensure coverage while upholding optimality. An empirical evaluation on three new benchmarks consisting of audio, image, and text data highlights the advantages of our approach, and a user study shows that annotators significantly prefer hierarchical over flat prediction sets.

置信预测分类层次结构不确定性量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。