利用类别标签生成伪标签,提升草图标注分割的鲁棒性
Exploiting Inherent Class Label: Towards Robust Scribble Supervised Semantic Segmentation
- 用类别标签生成可靠伪标签,弥补草图标注稀疏缺陷
- 在ScribbleCOCO和ScribbleCityscapes上达到领先精度
- 适合低资源标注场景,对标注风格变化不敏感
基于草图的弱监督语义分割仅需少量标注像素即可训练模型,显著降低人工标注成本。该方法面临两大挑战:草图标注稀疏导致预测不一致;不同标注者偏好差异使模型难以稳定捕捉物体关键区域。为此,本文提出类驱动草图增强网络,不仅利用原始草图,还结合其类别标签生成可靠伪标签。网络包含定位校正模块以缓解噪声标签,并引入距离感知模块识别草图及伪标签周围的可信区域。此外,构建了ScribbleCOCO和ScribbleCityscapes两个大规模新基准,并设计草图模拟算法,支持跨风格评估。实验表明,本方法在准确率与鲁棒性上均优于现有方法。数据集与代码将公开。
原文摘要 · Abstract (English)
Scribble-based weakly supervised semantic segmentation leverages only a few annotated pixels as labels to train a segmentation model, presenting significant potential for reducing the human labor involved in the annotation process. This approach faces two primary challenges: first, the sparsity of scribble annotations can lead to inconsistent predictions due to limited supervision; second, the variability in scribble annotations, reflecting differing human annotator preferences, can prevent the model from consistently capturing the discriminative regions of objects, potentially leading to unstable predictions. To address these issues, we propose a holistic framework, the class-driven scribble promotion network, for robust scribble-supervised semantic segmentation. This framework not only utilizes the provided scribble annotations but also leverages their associated class labels to generate reliable pseudo-labels. Within the network, we introduce a localization rectification module to mitigate noisy labels and a distance perception module to identify reliable regions surrounding scribble annotations and pseudo-labels. In addition, we introduce new large-scale benchmarks, ScribbleCOCO and ScribbleCityscapes, accompanied by a scribble simulation algorithm that enables evaluation across varying scribble styles. Our method demonstrates competitive performance in both accuracy and robustness, underscoring its superiority over existing approaches. The datasets and the codes will be made publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。