重新评估未见类别数据对半监督学习的影响,发现其未必有害甚至可能提升性能。
Re-Evaluating the Impact of Unseen-Class Unlabeled Data on Semi-Supervised Learning Model
- 控制变量严格实验,仅改变未见类比例研究影响。
- 未见类数据不必然降低模型性能,特定条件下还能提升效果。
- 为半监督学习中利用未知数据提供新思路,适合模型鲁棒性研究者。
半监督学习(SSL)有效利用无标签数据,在多个领域表现优异。现有安全型SSL方法认为,无标签数据中的未见类别会损害模型性能。然而,以往评估方法存在缺陷:固定无标签数据总量,通过调整未见类比例来测试影响,这违背了变量控制原则。因为未见类比例变化会同步改变已见类比例,导致性能下降可能源于已见类样本减少,而非未见类干扰。因此,此前‘未见类损害性能’的结论可能不成立。本文严格遵循变量控制原则,保持已见类在无标签数据中的比例不变,仅在五个关键维度上改变未见类,从全局与局部鲁棒性角度探究其影响。实验表明,未见类并不必然降低模型性能,反而在某些条件下可提升性能。
原文摘要 · Abstract (English)
Semi-supervised learning (SSL) effectively leverages unlabeled data and has been proven successful across various fields. Current safe SSL methods believe that unseen classes in unlabeled data harm the performance of SSL models. However, previous methods for assessing the impact of unseen classes on SSL model performance are flawed. They fix the size of the unlabeled dataset and adjust the proportion of unseen classes within the unlabeled data to assess the impact. This process contravenes the principle of controlling variables. Adjusting the proportion of unseen classes in unlabeled data alters the proportion of seen classes, meaning the decreased classification performance of seen classes may not be due to an increase in unseen class samples in the unlabeled data, but rather a decrease in seen class samples. Thus, the prior flawed assessment standard that ``unseen classes in unlabeled data can damage SSL model performance" may not always hold true. This paper strictly adheres to the principle of controlling variables, maintaining the proportion of seen classes in unlabeled data while only changing the unseen classes across five critical dimensions, to investigate their impact on SSL models from global robustness and local robustness. Experiments demonstrate that unseen classes in unlabeled data do not necessarily impair the performance of SSL models; in fact, under certain conditions, unseen classes may even enhance them.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。