通过将异常样本转为新类别,缓解开放集半监督学习中的过信任问题。
SCOMatch: Alleviating Overtrusting in Open-set Semi-supervised Learning
- 将未知类样本视为新类别,用记忆队列筛选可靠样本
- 在多个基准上显著优于当前最佳方法,提升分类准确率
- 适合处理包含未知类别的实际场景,如自动驾驶识别陌生物体
开放集半监督学习(OSSL)利用包含已知类别(ID)和未知类别(OOD)的未标记数据进行学习。现有方法先用少量标注的已知类数据学习区分已知与未知的边界,再通过自训练优化。但这类方法容易过度依赖标注数据:由于标注数据稀缺,导致标注样本分布与整体已知数据分布存在偏差,使边界过拟合;后续自训练基于此错误边界,无法纠正。本文提出SCOMatch,通过将异常样本视为额外类别,构建新的半监督流程。具体包括:1)利用异常样本记忆队列及更新策略,筛选可靠异常样本作为新增标注数据;2)通过同步闭集与开集自训练机制,将新流程融入原任务。该方法在全数据集上优化已知与未知类边界,显著提升性能。大量实验表明,SCOMatch在多个基准上显著超越当前最优方法,消融实验与可视化进一步验证其有效性。
原文摘要 · Abstract (English)
Open-set semi-supervised learning (OSSL) leverages practical open-set unlabeled data, comprising both in-distribution (ID) samples from seen classes and out-of-distribution (OOD) samples from unseen classes, for semi-supervised learning (SSL). Prior OSSL methods initially learned the decision boundary between ID and OOD with labeled ID data, subsequently employing self-training to refine this boundary. These methods, however, suffer from the tendency to overtrust the labeled ID data: the scarcity of labeled data caused the distribution bias between the labeled samples and the entire ID data, which misleads the decision boundary to overfit. The subsequent self-training process, based on the overfitted result, fails to rectify this problem. In this paper, we address the overtrusting issue by treating OOD samples as an additional class, forming a new SSL process. Specifically, we propose SCOMatch, a novel OSSL method that 1) selects reliable OOD samples as new labeled data with an OOD memory queue and a corresponding update strategy and 2) integrates the new SSL process into the original task through our Simultaneous Close-set and Open-set self-training. SCOMatch refines the decision boundary of ID and OOD classes across the entire dataset, thereby leading to improved results. Extensive experimental results show that SCOMatch significantly outperforms the state-of-the-art methods on various benchmarks. The effectiveness is further verified through ablation studies and visualization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。