用分块辅助模型生成伪标签,解决部分标签学习中的错误标签干扰问题。
Reduction-based Pseudo-label Generation for Instance-dependent Partial Label Learning
- 构建多分支辅助模型,每支在排除某些标签的子空间训练
- 通过加权聚合生成更一致的伪标签,提升模型准确性
- 适合处理标签噪声大、正确标签未知的复杂分类任务
实例相关部分标签学习(ID-PLL)旨在仅根据与特征相关的候选标签集训练多分类模型,其中正确标签虽固定但未知。现有方法依赖训练模型自身识别能力迭代优化监督信息,但忽视了模型易过拟合于错误候选标签的问题,导致监督信息质量下降,形成训练瓶颈。本文提出基于降维的伪标签生成方法,以缓解错误标签的影响。具体地,通过在每个排除特定标签的标签子空间中训练多分支辅助模型,对各分支输出进行加权聚合生成伪标签。该策略使受排除标签干扰的实例能从不受影响的分支中获益。理论上证明,相比直接从预测模型生成的伪标签,该方法生成的伪标签与贝叶斯最优分类器具有更高一致性。
原文摘要 · Abstract (English)
Instance-dependent Partial Label Learning (ID-PLL) aims to learn a multi-class predictive model given training instances annotated with candidate labels related to features, among which correct labels are hidden fixed but unknown. The previous works involve leveraging the identification capability of the training model itself to iteratively refine supervision information. However, these methods overlook a critical aspect of ID-PLL: the training model is prone to overfitting on incorrect candidate labels, thereby providing poor supervision information and creating a bottleneck in training. In this paper, we propose to leverage reduction-based pseudo-labels to alleviate the influence of incorrect candidate labels and train our predictive model to overcome this bottleneck. Specifically, reduction-based pseudo-labels are generated by performing weighted aggregation on the outputs of a multi-branch auxiliary model, with each branch trained in a label subspace that excludes certain labels. This approach ensures that each branch explicitly avoids the disturbance of the excluded labels, allowing the pseudo-labels provided for instances troubled by these excluded labels to benefit from the unaffected branches. Theoretically, we demonstrate that reduction-based pseudo-labels exhibit greater consistency with the Bayes optimal classifier compared to pseudo-labels directly generated from the predictive model.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。