arXiv:2412.07324cs.LG2024-12中稿 · 2025 The Conferenc…被引 1

提出新模型SNEFY-LDL,用概率分布捕捉标签不确定性。

Label Distribution Learning using the Squared Neural Family on the Probability Simplex

  • 用平方神经族建模标签分布的完整概率密度
  • 可计算均值方差协方差,量化预测不确定性
  • 适合需要可信度评估的标注任务

标签分布学习(LDL)框架通过预测类别上的概率分布而非单一类别,来应对标注数据中的模糊性。现有研究多聚焦于点估计,即在给定样本下寻找最优分布。本文提出SNEFY-LDL模型,利用最近提出的平方神经族(SNEFY)这一可计算概率模型,对概率单纯形上所有可能标签分布进行建模,估计其完整概率分布。通过该模型可导出条件均值、方差与协方差的闭式解,用于预测真实标签分布、构建置信区间,并度量不同标签间的相关性。此外,从建模的概率密度函数中还能获取更多预测不确定性信息。在符合性预测、主动学习和集成学习上的大量实验验证了该模型在标签分布不确定性量化方面的优异表现。代码已开源。

原文摘要 · Abstract (English)

Label distribution learning (LDL) provides a framework wherein a distribution over categories rather than a single category is predicted, with the aim of addressing ambiguity in labeled data. Existing research on LDL mainly focuses on the task of point estimation, i.e., finding an optimal distribution in the probability simplex conditioned on the given sample. In this paper, we propose a novel label distribution learning model SNEFY-LDL, which estimates a probability distribution of all possible label distributions over the simplex, by unleashing the expressive power of the recently introduced Squared Neural Family (SNEFY), a new class of tractable probability models. As a way to summarize the fitted model, we derive the closed-form label distribution mean, variance and covariance conditioned on the given sample, which can be used to predict the ground-truth label distributions, construct label distribution confidence intervals, and measure the correlations between different labels. Moreover, more information about the label distribution prediction uncertainties can be acquired from the modeled probability density function. Extensive experiments on conformal prediction, active learning and ensemble learning are conducted, verifying SNEFY-LDL's great effectiveness in LDL uncertainty quantification. The source code of this paper is available at https://github.com/daokunzhang/SNEFY-LDL.

标签分布不确定性概率建模机器学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。