针对长尾半监督学习中的分布不匹配问题,提出动态专家分配与多深度特征融合方法。
A Square Peg in a Square Hole: Meta-Expert for Long-Tailed Semi-Supervised Learning
- 根据样本类别位置动态分配不同专家,提升伪标签质量。
- 在CIFAR-10-LT等数据集上准确率提升3.2%以上,显著优于基线方法。
- 适合处理类别分布不均衡的半监督学习场景,尤其关注长尾问题。
本文研究长尾半监督学习(LTSSL)中的分布不匹配问题,即有标签数据的类别分布为长尾分布,且与无标签数据分布不一致。现有方法虽引入多个辅助分类器(专家)建模不同无标签数据分布并生成伪标签,但未充分挖掘各专家的优势。我们观察到:不同专家擅长预测不同区间样本——头部专家擅长头类样本,均匀专家在中段表现更优。为此,提出动态专家分配模块,通过估计样本的类别归属(头、中、尾),动态分配合适专家以生成高质量伪标签和测试预测。理论上证明,融合各专家优势可降低泛化误差界。此外,发现深层特征对头类更偏倚但判别性强,浅层特征偏倚小但判别性弱,因此提出多深度特征融合模块以缓解模型偏差。在CIFAR-10-LT、STL-10-LT和SVHN-LT多个数据集上,多种设置下均验证了方法的有效性。
原文摘要 · Abstract (English)
This paper studies the long-tailed semi-supervised learning (LTSSL) with distribution mismatch, where the class distribution of the labeled training data follows a long-tailed distribution and mismatches with that of the unlabeled training data. Most existing methods introduce auxiliary classifiers (experts) to model various unlabeled data distributions and produce pseudo-labels, but the expertises of various experts are not fully utilized. We observe that different experts are good at predicting different intervals of samples, e.g., long-tailed expert is skilled in samples located in the head interval and uniform expert excels in samples located in the medium interval. Therefore, we propose a dynamic expert assignment module that can estimate the class membership (i.e., head, medium, or tail class) of samples, and dynamically assigns suitable expert to each sample based on the estimated membership to produce high-quality pseudo-label in the training phase and produce prediction in the testing phase. We also theoretically reveal that integrating different experts' strengths will lead to a smaller generalization error bound. Moreover, we find that the deeper features are more biased toward the head class but with more discriminative ability, while the shallower features are less biased but also with less discriminative ability. We, therefore, propose a multi-depth feature fusion module to utilize different depth features to mitigate the model bias. Our method demonstrates its effectiveness through comprehensive experiments on the CIFAR-10-LT, STL-10-LT, and SVHN-LT datasets across various settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。