arXiv:2502.07661cs.LGstat.ML2025-02中稿 · UAI 2025被引 2

用置信度校准清洗候选标签,提升模糊标注下的分类准确率

Partial-Label Learning with Conformal Candidate Cleaning

  • 通过交替优化分类器与候选集修剪,利用置信区间动态删减错误标签
  • 在多个真实与人工数据集上,显著提升主流部分标签学习模型的测试精度
  • 无需真实验证标签,适合标注不明确的工业场景使用

现实数据常存在标注模糊问题,如人工标注中同一实例包含多个冲突标签。部分标签学习(PLL)旨在处理此类挑战:每个样本关联一组候选标签,但仅有一个正确标签未知。现有大量方法针对此设置,为提升预测质量,已有多种可通用的改进策略被提出。然而多数依赖启发式规则。本文提出一种新方法,通过置信区间预测逐步剪枝候选标签集合。为解决置信预测通常需要已标注验证集的问题,我们设计一种交替策略:先训练PLL分类器对验证集进行预测,再利用预测标签进行校准,并剔除不在置信集内的候选标签。该过程交替进行经验风险最小化与候选集剪枝。理论证明该剪枝方法保持了对未知真实标签的置信有效性。大量实验表明,该方法在多个真实与人工数据集上显著提升了多个先进PLL分类器的测试准确率。

原文摘要 · Abstract (English)

Real-world data is often ambiguous; for example, human annotation produces instances with multiple conflicting class labels. Partial-label learning (PLL) aims at training a classifier in this challenging setting, where each instance is associated with a set of candidate labels and one correct, but unknown, class label. A multitude of algorithms targeting this setting exists and, to enhance their prediction quality, several extensions that are applicable across a wide range of PLL methods have been introduced. While many of these extensions rely on heuristics, this article proposes a novel enhancing method that incrementally prunes candidate sets using conformal prediction. To work around the missing labeled validation set, which is typically required for conformal prediction, we propose a strategy that alternates between training a PLL classifier to label the validation set, leveraging these predicted class labels for calibration, and pruning candidate labels that are not part of the resulting conformal sets. In this sense, our method alternates between empirical risk minimization and candidate set pruning. We establish that our pruning method preserves the conformal validity with respect to the unknown ground truth. Our extensive experiments on artificial and real-world data show that the proposed approach significantly improves the test set accuracies of several state-of-the-art PLL classifiers.

部分标签学习置信预测标签清洗机器学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。