arXiv:2410.22883cs.CVcs.AI2024-10

针对长尾数据集,提出逐样本优化的动态温度机制提升自监督学习性能。

Dataset Awareness is not Enough: Implementing Sample-level Tail Encouragement in Long-tailed Self-supervised Learning

  • 为每个样本动态分配最优温度参数,实现细粒度训练引导。
  • 在六个基准上显著提升长尾识别准确率,平均提升超过5%。
  • 适合需要高精度长尾分类的工业级视觉系统开发者。

自监督学习(SSL)在多种数据集上展现出强大的表征能力,但在真实世界中具有长尾分布的数据集上,下游任务性能显著下降。近期研究开始关注自监督长尾学习,部分工作尝试将温度机制迁移至自监督学习或使用类别空间均匀性约束以平衡嵌入空间中的各类别表征。然而,这些方法大多聚焦于全数据集联合优化或类别分布约束,忽视了单个样本在训练过程中是否得到最优引导。为此,本文提出温度辅助逐样本激励(TASE),在自监督长尾学习中引入伪标签,利用伪标签信息驱动动态温度与重加权策略,为每个样本分配最优温度参数。同时分析温度参数缺乏数量感知的问题,并通过重加权进行补偿,从而实现样本级别的最优训练模式。在三个数据集上的六个基准测试中,实验结果表明该方法显著提升长尾识别性能,且具备高鲁棒性。

原文摘要 · Abstract (English)

Self-supervised learning (SSL) has shown remarkable data representation capabilities across a wide range of datasets. However, when applied to real-world datasets with long-tailed distributions, performance on multiple downstream tasks degrades significantly. Recently, the community has begun to focus more on self-supervised long-tailed learning. Some works attempt to transfer temperature mechanisms to self-supervised learning or use category-space uniformity constraints to balance the representation of different categories in the embedding space to fight against long-tail distributions. However, most of these approaches focus on the joint optimization of all samples in the dataset or on constraining the category distribution, with little attention given to whether each individual sample is optimally guided during training. To address this issue, we propose Temperature Auxiliary Sample-level Encouragement (TASE). We introduce pseudo-labels into self-supervised long-tailed learning, utilizing pseudo-label information to drive a dynamic temperature and re-weighting strategy. Specifically, We assign an optimal temperature parameter to each sample. Additionally, we analyze the lack of quantity awareness in the temperature parameter and use re-weighting to compensate for this deficiency, thereby achieving optimal training patterns at the sample level. Comprehensive experimental results on six benchmarks across three datasets demonstrate that our method achieves outstanding performance in improving long-tail recognition, while also exhibiting high robustness.

长尾学习自监督样本级优化动态温度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。