arXiv:2505.22028cs.LG2025-05ICML被引 2

用语义相似度替代模糊标签,提升弱监督对比学习效果

Weakly-Supervised Contrastive Learning for Imprecise Class Labels

  • 以语义相似度构建正负样本对,避免依赖错误标签
  • 在噪声标签和部分标签场景下显著提升模型性能
  • 框架通用性强,适合多种弱监督学习任务

对比学习在表征学习中表现优异,但真实场景中标签常不准确,导致监督对比学习受限。本文提出“连续语义相似度”概念,不直接依赖模糊标签,而是通过迭代优化弱监督信号,量化样本对属于同一类别的程度。基于此,构建图结构框架,以语义相似度作为边权重。该方法适用于多种弱监督场景,在噪声标签和部分标签学习中均取得显著提升,且可与现有方法无缝集成。理论分析表明,在温和条件下,其性能可逼近监督对比学习。代码已开源。

原文摘要 · Abstract (English)

Contrastive learning has achieved remarkable success in learning effective representations, with supervised contrastive learning often outperforming self-supervised approaches. However, in real-world scenarios, data annotations are often ambiguous or inaccurate, meaning that class labels may not reliably indicate whether two examples belong to the same class. This limitation restricts the applicability of supervised contrastive learning. To address this challenge, we introduce the concept of ``continuous semantic similarity'' to define positive and negative pairs. Instead of directly relying on imprecise class labels, we measure the semantic similarity between example pairs, which quantifies how closely they belong to the same category by iteratively refining weak supervisory signals. Based on this concept, we propose a graph-theoretic framework for weakly-supervised contrastive learning, where semantic similarity serves as the graph weights. Our framework is highly versatile and can be applied to many weakly-supervised learning scenarios. We demonstrate its effectiveness through experiments in two common settings, i.e., noisy label and partial label learning, where existing methods can be easily integrated to significantly improve performance. Theoretically, we establish an error bound for our approach, showing that it can approximate supervised contrastive learning under mild conditions. The implementation code is available at https://github.com/Speechless-10308/WSC.

对比学习弱监督语义相似度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。