arXiv:2410.14242cs.CVcs.LG2024-10被引 5

通过融合前后周期聚类信息,提升自监督学习中的伪标签质量。

Pseudo-label Refinement for Improving Self-Supervised Learning Systems

  • 用前一周期标签投影修正当前聚类标签,生成带历史信息的软伪标签。
  • 在无监督域适应的行人重识别任务中,mAP显著提升,最高达8.7%增长。
  • 适合做自监督学习中伪标签噪声敏感的任务,如跨域图像识别。

近年来,自监督学习系统通过基于聚类的伪标签提供无需人工标注的监督信号,但聚类方法引入的噪声会损害学习效果。本文提出一种伪标签精炼(SLR)算法:将前一周期的聚类标签投影到当前周期的标签空间,计算新标签与投影标签的线性组合,生成融合历史信息的软伪标签。不同于直接取最大值生成硬标签,我们对软伪标签进行层次聚类以生成更优的硬标签。在无监督域适应(UDA)下的行人重识别(Re-ID)任务中,加入SLR的基线模型在真实到合成、合成到真实及不同真实域间等多类场景中均实现显著提升,平均精度(mAP)最高提升8.7%。结果验证了该方法在增强自监督学习性能上的有效性。

原文摘要 · Abstract (English)

Self-supervised learning systems have gained significant attention in recent years by leveraging clustering-based pseudo-labels to provide supervision without the need for human annotations. However, the noise in these pseudo-labels caused by the clustering methods poses a challenge to the learning process leading to degraded performance. In this work, we propose a pseudo-label refinement (SLR) algorithm to address this issue. The cluster labels from the previous epoch are projected to the current epoch cluster-labels space and a linear combination of the new label and the projected label is computed as a soft refined label containing the information from the previous epoch clusters as well as from the current epoch. In contrast to the common practice of using the maximum value as a cluster/class indicator, we employ hierarchical clustering on these soft pseudo-labels to generate refined hard-labels. This approach better utilizes the information embedded in the soft labels, outperforming the simple maximum value approach for hard label generation. The effectiveness of the proposed SLR algorithm is evaluated in the context of person re-identification (Re-ID) using unsupervised domain adaptation (UDA). Experimental results demonstrate that the modified Re-ID baseline, incorporating the SLR algorithm, achieves significantly improved mean Average Precision (mAP) performance in various UDA tasks, including real-to-synthetic, synthetic-to-real, and different real-to-real scenarios. These findings highlight the efficacy of the SLR algorithm in enhancing the performance of self-supervised learning systems.

自监督学习伪标签行人重识别聚类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。