arXiv:2505.24443cs.CVcs.LG2025-05中稿 · IEEE Transactions …被引 6

用多模型分歧识别异常数据,让半监督学习更抗干扰。

Diversify and Conquer: Open-set Disagreement for Robust Semi-supervised Learning with Outliers

  • 训练多个有偏差的模型,利用预测分歧检测未知类别
  • 即使标注数据少,也能有效区分异常点与正常数据
  • 适合标注不全、含噪声的真实场景应用

传统半监督学习假设标注与未标注数据具有相同类别分布,但实际中未标注数据常包含未知类别(即异常点),被当作噪声会严重降低模型性能。为此,本文提出新框架 Diversify and Conquer(DAC),在开放集半监督学习下提升鲁棒性。现有方法依赖单个模型对异常点与正常点的预测差异,当标注数据不足时易失效。本方法通过一次训练构建多个对未标注数据具有不同偏见的模型,使它们对正常数据预测一致,对异常数据产生分歧,从而以分歧度作为未知概念的识别依据。核心创新在于在单一训练流程中生成多样化且具差异偏见的模型头,实现强鲁棒性异常检测。代码已开源:https://github.com/heejokong/DivCon。

原文摘要 · Abstract (English)

Conventional semi-supervised learning (SSL) ideally assumes that labeled and unlabeled data share an identical class distribution, however in practice, this assumption is easily violated, as unlabeled data often includes unknown class data, i.e., outliers. The outliers are treated as noise, considerably degrading the performance of SSL models. To address this drawback, we propose a novel framework, Diversify and Conquer (DAC), to enhance SSL robustness in the context of open-set semi-supervised learning. In particular, we note that existing open-set SSL methods rely on prediction discrepancies between inliers and outliers from a single model trained on labeled data. This approach can be easily failed when the labeled data is insufficient, leading to performance degradation that is worse than naive SSL that do not account for outliers. In contrast, our approach exploits prediction disagreements among multiple models that are differently biased towards the unlabeled distribution. By leveraging the discrepancies arising from training on unlabeled data, our method enables robust outlier detection even when the labeled data is underspecified. Our key contribution is constructing a collection of differently biased models through a single training process. By encouraging divergent heads to be differently biased towards outliers while making consistent predictions for inliers, we exploit the disagreement among these heads as a measure to identify unknown concepts. Our code is available at https://github.com/heejokong/DivCon.

半监督学习异常检测开放集学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。