arXiv:2412.05029cs.LG2024-12KDD被引 12

通过类别嵌入与原型建模,解决实例相关噪声标签的模糊性问题。

Mixed Blessing: Class-Wise Embedding guided Instance-Dependent Partial Label Learning

  • 为每个样本构建类别嵌入,捕捉噪声标签与真实标签的关联性。
  • 在六个数据集上超越12种方法,细粒度分类任务提升显著。
  • 适合处理真实场景中标签不明确的半监督学习任务。

在部分标签学习(PLL)中,每个样本对应一个包含真实标签和若干噪声标签的候选标签集。传统PLL假设噪声标签随机生成(实例无关),但实际中噪声标签具有实例相关性,与样本特征高度相关,形成实例相关部分标签学习(IDPLL)问题。实例相关噪声标签是一把双刃剑:一方面可辅助模型训练,因噪声标签在一定程度上反映样本特征;另一方面加剧标签模糊性,使噪声标签与真实标签难以区分。为此,本文首次为每个样本构建类别嵌入,探索实例相关噪声标签的关系——候选标签集内的类别嵌入应高度相似,而候选与非候选标签集间应高度相异。此外,引入包含全局特征信息的类别原型,以缓解高标签模糊性。在六个基准数据集(含四个细粒度数据集)上的大量实验表明,该方法优于12种现有方法。代码已公开于https://github.com/Yangfc-ML/CEL。

原文摘要 · Abstract (English)

In partial label learning (PLL), every sample is associated with a candidate label set comprising the ground-truth label and several noisy labels. The conventional PLL assumes the noisy labels are randomly generated (instance-independent), while in practical scenarios, the noisy labels are always instance-dependent and are highly related to the sample features, leading to the instance-dependent partial label learning (IDPLL) problem. Instance-dependent noisy label is a double-edged sword. On one side, it may promote model training as the noisy labels can depict the sample to some extent. On the other side, it brings high label ambiguity as the noisy labels are quite undistinguishable from the ground-truth label. To leverage the nuances of IDPLL effectively, for the first time we create class-wise embeddings for each sample, which allow us to explore the relationship of instance-dependent noisy labels, i.e., the class-wise embeddings in the candidate label set should have high similarity, while the class-wise embeddings between the candidate label set and the non-candidate label set should have high dissimilarity. Moreover, to reduce the high label ambiguity, we introduce the concept of class prototypes containing global feature information to disambiguate the candidate label set. Extensive experimental comparisons with twelve methods on six benchmark data sets, including four fine-grained data sets, demonstrate the effectiveness of the proposed method. The code implementation is publicly available at https://github.com/Yangfc-ML/CEL.

部分标签学习类别嵌入噪声标签细粒度分类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。