提出新方法解决半监督分割中伪标签选择的过自信问题
When Confidence Fails: Revisiting Pseudo-Label Selection in Semi-supervised Semantic Segmentation
- 将伪标签选择建模为置信度空间的凸优化,自适应划分可靠与不可靠预测
- 在Pascal、Cityscapes和COCO上优于现有方法,提升分割精度
- 适合关注半监督学习中标签噪声与上下文信息保留的研究者
尽管半监督语义分割中的伪标签生成已有显著进展,但伪标签选择仍缺乏深入研究。现有方法通常使用固定置信度阈值保留高置信度预测作为伪标签,然而难以应对模型过自信倾向——正确与错误预测在高置信区域重叠严重,导致难以区分并放大认知偏差。同时,直接丢弃低置信度预测会破坏空间-语义连续性,造成关键上下文丢失。本文提出置信度可分离学习(CSL),将伪标签选择建模为置信度分布特征空间中的凸优化问题,建立样本特定决策边界以区分可靠与不可靠预测。此外,通过随机遮蔽可靠像素,引导网络从低可靠性区域学习上下文关系,缓解丢弃不确定预测的负面影响。在Pascal、Cityscapes和COCO基准上的大量实验表明,CSL优于当前最优方法。代码与模型权重已公开于https://github.com/PanLiuCSU/CSL。
原文摘要 · Abstract (English)
While significant advances exist in pseudo-label generation for semi-supervised semantic segmentation, pseudo-label selection remains understudied. Existing methods typically use fixed confidence thresholds to retain high-confidence predictions as pseudo-labels. However, these methods cannot cope with network overconfidence tendency, where correct and incorrect predictions overlap significantly in high-confidence regions, making separation challenging and amplifying model cognitive bias. Meanwhile, the direct discarding of low-confidence predictions disrupts spatial-semantic continuity, causing critical context loss. We propose Confidence Separable Learning (CSL) to address these limitations. CSL formulates pseudo-label selection as a convex optimization problem within the confidence distribution feature space, establishing sample-specific decision boundaries to distinguish reliable from unreliable predictions. Additionally, CSL introduces random masking of reliable pixels to guide the network in learning contextual relationships from low-reliability regions, thereby mitigating the adverse effects of discarding uncertain predictions. Extensive experimental results on the Pascal, Cityscapes, and COCO benchmarks show that CSL performs favorably against state-of-the-art methods. Code and model weights are available at https://github.com/PanLiuCSU/CSL.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。