提出可控伪标签生成框架,让模型在未知分布的无标签数据下仍能稳定提升性能。
Keep It on a Leash: Controllable Pseudo-label Generation Towards Realistic Long-Tailed Semi-Supervised Learning
- 通过动态筛选可靠伪标签,构建已知分布的标签数据集
- 迭代优化使模型准确率最高提升15.97%
- 适合长尾分布且无标签数据分布未知的场景
现有长尾半监督学习方法假设标签数据呈长尾分布,而无标签数据服从预设分布(如长尾、均匀或逆长尾)。然而,无标签数据的实际分布通常未知,可能为任意分布。为此,我们提出可控伪标签生成(CPG)框架:通过逐步识别可靠的无标签数据伪标签来扩展标签数据集,并在具有已知分布的更新后标签数据集上训练模型,从而不受无标签数据分布影响。CPG采用可控自增强优化循环:(i) 每轮训练中,动态可控过滤机制从无标签数据中选择可靠伪标签加入标签集,确保更新后的标签集遵循已知分布;(ii) 基于更新后的标签分布,通过对数调整构建贝叶斯最优分类器;(iii) 该改进分类器进一步帮助下一轮识别更可靠的伪标签。我们进一步理论上证明,在一定条件下该循环可显著降低泛化误差。此外,提出类别感知自适应增强模块以提升少数类表征,并设计辅助分支以充分利用所有标签和无标签样本。在多个常用基准数据集上的全面评估表明,CPG实现持续提升,准确率最高超越现有方法15.97%。代码已公开于https://github.com/yaxinhou/CPG。
原文摘要 · Abstract (English)
Current long-tailed semi-supervised learning methods assume that labeled data exhibit a long-tailed distribution, and unlabeled data adhere to a typical predefined distribution (i.e., long-tailed, uniform, or inverse long-tailed). However, the distribution of the unlabeled data is generally unknown and may follow an arbitrary distribution. To tackle this challenge, we propose a Controllable Pseudo-label Generation (CPG) framework, expanding the labeled dataset with the progressively identified reliable pseudo-labels from the unlabeled dataset and training the model on the updated labeled dataset with a known distribution, making it unaffected by the unlabeled data distribution. Specifically, CPG operates through a controllable self-reinforcing optimization cycle: (i) at each training step, our dynamic controllable filtering mechanism selectively incorporates reliable pseudo-labels from the unlabeled dataset into the labeled dataset, ensuring that the updated labeled dataset follows a known distribution; (ii) we then construct a Bayes-optimal classifier using logit adjustment based on the updated labeled data distribution; (iii) this improved classifier subsequently helps identify more reliable pseudo-labels in the next training step. We further theoretically prove that this optimization cycle can significantly reduce the generalization error under some conditions. Additionally, we propose a class-aware adaptive augmentation module to further improve the representation of minority classes, and an auxiliary branch to maximize data utilization by leveraging all labeled and unlabeled samples. Comprehensive evaluations on various commonly used benchmark datasets show that CPG achieves consistent improvements, surpassing state-of-the-art methods by up to $\textbf{15.97%}$ in accuracy. The code is available at https://github.com/yaxinhou/CPG.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。