arXiv:2409.19600cs.LGcs.AI2024-09

提出新方法解决训练后新增类别问题,理论保障风险估计无偏。

An Unbiased Risk Estimator for Partial Label Learning with Augmented Classes

  • 从无标签数据中区分已知与新增类别的分布,实现无偏风险估计。
  • 理论证明样本量增大时,经验风险最小化收敛到真实风险最小化。
  • 可适配任意部分标签损失函数,适合持续学习和开放环境场景。

部分标签学习(PLL)是一种典型的弱监督学习任务,假设每个训练样本的标签是一个包含真实标签的候选标签集合。现有方法采用基于识别的消歧策略缓解误报标签的影响,表现良好,但要求测试集中的所有类别必须在训练阶段出现,忽略了实际应用中新类别不断涌现的情况。针对此问题,本文研究了部分标签学习与新增类别(PLLAC)的问题,其中一个或多个新增类别在训练阶段不可见,但在推理阶段出现。为此,我们提出一种具有理论保证的无偏风险估计器,通过区分无标签数据中已知类与新增类的分布来估计新增类的分布,且可与任意的PLL损失函数结合使用。此外,我们提供了该估计器的估计误差界理论分析,证明了当训练样本数量趋于无穷时,经验风险最小化器收敛至真实风险最小化器。同时,在优化目标中引入风险惩罚正则项,以缓解由负经验风险引起的过拟合问题。在基准数据集、UCI数据集及真实世界数据集上的大量实验验证了所提方法的有效性。

原文摘要 · Abstract (English)

Partial Label Learning (PLL) is a typical weakly supervised learning task, which assumes each training instance is annotated with a set of candidate labels containing the ground-truth label. Recent PLL methods adopt identification-based disambiguation to alleviate the influence of false positive labels and achieve promising performance. However, they require all classes in the test set to have appeared in the training set, ignoring the fact that new classes will keep emerging in real applications. To address this issue, in this paper, we focus on the problem of Partial Label Learning with Augmented Class (PLLAC), where one or more augmented classes are not visible in the training stage but appear in the inference stage. Specifically, we propose an unbiased risk estimator with theoretical guarantees for PLLAC, which estimates the distribution of augmented classes by differentiating the distribution of known classes from unlabeled data and can be equipped with arbitrary PLL loss functions. Besides, we provide a theoretical analysis of the estimation error bound of the estimator, which guarantees the convergence of the empirical risk minimizer to the true risk minimizer as the number of training data tends to infinity. Furthermore, we add a risk-penalty regularization term in the optimization objective to alleviate the influence of the over-fitting issue caused by negative empirical risk. Extensive experiments on benchmark, UCI and real-world datasets demonstrate the effectiveness of the proposed approach.

部分标签新增类别无偏估计理论保障

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。