提出新方法提升无负样本学习性能,显著缩小与有监督模型的差距。
Noisy-Pair Robust Representation Alignment for Positive-Unlabeled Learning
- 用抗噪声对的非对比损失对齐同类特征,应对标注不可靠问题。
- 在CIFAR-100上相比最优基线提升14.26%,在灾后建筑损毁识别中表现优异。
- 无需额外负样本或预设参数,适合真实场景中缺乏标注数据的应用。
正例-无标签(PU)学习旨在仅拥有少量正例和大量无标签数据时训练二分类器。尽管应用广泛,现有顶尖方法在复杂数据集上仍显著落后于有监督方法,尤其在无辅助负样本或预估参数时(如在CIFAR-100上差距达14.26%)。我们发现主要瓶颈在于不可靠监督下学习判别性表示的困难。为此,提出NcPU——一种无需辅助信息的非对比PU学习框架。该框架结合抗噪声对的鲁棒监督非对比损失(NoiSNCL),可在不可靠监督下对齐类内表示;以及基于后悔机制的虚设标签消歧(PLD)方案,通过迭代更新提供保守负样本监督。理论上,二者在期望-最大化框架下可相互促进。实验表明:(1) NoiSNCL使简单PU方法达到竞争力表现;(2) NcPU在多种数据集上显著优于当前最优方法,包括灾后建筑损毁检测等挑战性任务,凸显其实际应用潜力。代码将在评审后开源。
原文摘要 · Abstract (English)
Positive-Unlabeled (PU) learning aims to train a binary classifier (positive vs. negative) where only limited positive data and abundant unlabeled data are available. While widely applicable, state-of-the-art PU learning methods substantially underperform their supervised counterparts on complex datasets, especially without auxiliary negatives or pre-estimated parameters (e.g., a 14.26% gap on CIFAR-100 dataset). We identify the primary bottleneck as the challenge of learning discriminative representations under unreliable supervision. To tackle this challenge, we propose NcPU, a non-contrastive PU learning framework that requires no auxiliary information. NcPU combines a noisy-pair robust supervised non-contrastive loss (NoiSNCL), which aligns intra-class representations despite unreliable supervision, with a phantom label disambiguation (PLD) scheme that supplies conservative negative supervision via regret-based label updates. Theoretically, NoiSNCL and PLD can iteratively benefit each other from the perspective of the Expectation-Maximization framework. Empirically, extensive experiments demonstrate that: (1) NoiSNCL enables simple PU methods to achieve competitive performance; and (2) NcPU achieves substantial improvements over state-of-the-art PU methods across diverse datasets, including challenging datasets on post-disaster building damage mapping, highlighting its promise for real-world applications. Code: Code will be open-sourced after review.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。