arXiv:2601.11670cs.LGcs.AI2026-01

用置信度与类别方差联合判断伪标签可靠性,提升半监督学习效果。

CoVar: Confidence-Variance-Guided Pseudo-Label Selection for Semi-Supervised Learning

  • 结合置信度和类别方差构建伪标签筛选机制,避免单一置信度偏差。
  • 在PASCAL VOC和Cityscapes上显著提升分割性能,分类任务也表现优异。
  • 无需调参、无推理开销,可直接嵌入现有训练流程,适合实际应用。

半监督学习中的伪标签选择通常依赖最大置信度阈值,但置信度在模型过自信和类别不平衡时不可靠。本文提出CoVar,一种融合最大置信度(MC)与残差类别方差(RCV)的框架,通过熵最小化推导出二阶交叉熵近似,发现当MC高且RCV低时,低损失伪标签更可信,并引入随置信度增强的惩罚项。基于此准则,CoVar将预测映射至二维置信度-方差空间,利用SVD谱松弛法自动分离可靠与不可靠预测,无需人工设定阈值。随后通过类内高斯加权将分离结果转化为样本级训练权重。该权重可无缝集成至现有分割与分类训练流程,不增加推理开销。在PASCAL VOC 2012、Cityscapes、CIFAR-10、CIFAR-100、SVHN和STL-10上的实验表明,使用相同主干网络时,CoVar在VOC和Cityscapes上取得明显提升,在标准分类基准上达到竞争性或更优错误率。结果表明,残差类别离散度为伪标签选择提供了与置信度互补的可靠信号。

原文摘要 · Abstract (English)

Pseudo-label selection in semi-supervised learning is commonly driven by maximum-confidence thresholds, yet confidence alone can be unreliable under model overconfidence and class imbalance. We propose CoVar, a confidence--variance framework that assesses pseudo-label reliability by jointly modeling Maximum Confidence (MC) and Residual-Class Variance (RCV). Starting from entropy minimization, we derive a second-order cross-entropy approximation showing that low-loss pseudo-labels are favored when MC is high and RCV is low, with a confidence-dependent penalty that becomes stronger for near-certain predictions. Based on this criterion, CoVar embeds predictions into a two-dimensional confidence--variance space and uses SVD-based spectral relaxation to separate reliable and unreliable predictions without hand-tuned confidence thresholds. Cluster-wise Gaussian weighting then converts this separation into per-sample training weights. The resulting weights can be integrated into existing semi-supervised segmentation and classification pipelines during training and introduce no inference-time overhead. Experiments on PASCAL VOC 2012, Cityscapes, CIFAR-10, CIFAR-100, SVHN, and STL-10 show clear gains on VOC and Cityscapes under matched backbones, as well as competitive or improved error rates on standard classification benchmarks. These results indicate that residual-class dispersion provides a useful signal complementary to confidence for robust pseudo-label selection.

半监督学习伪标签图像分割模型鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。