arXiv:2503.17914cs.MMcs.CV2025-03中稿 · IEEE Transactions …被引 23

通过多约束一致性学习,提升半监督语义分割的编码器与解码器性能。

Semi-supervised Semantic Segmentation with Multi-Constraint Consistency Learning

  • 设计特征对齐策略,增强编码器在图像增强下的特征一致性。
  • 引入自适应干扰模块,通过实例级扰动提升解码器鲁棒性。
  • 在Pascal VOC2012和Cityscapes上达到新最佳效果,适合分割研究者参考。

一致性正则化在半监督语义分割中广泛应用并取得优异表现。然而,现有方法通常聚焦于增强基于图像增强的预测一致性,并整体优化分割网络,导致潜在监督信息利用不足。本文提出多约束一致性学习(MCCL)方法,分阶段提升编码器与解码器性能。首先设计特征知识对齐(FKA)策略,从点对点对齐和原型内聚性两个角度促进编码器在强弱增强视图间的特征一致性。此外,提出自适应干预(SAI)模块,通过实例特定的特征掩蔽与噪声注入,增强中间特征表示的差异性,从而推动基于特征扰动的预测一致性学习。在Pascal VOC2012与Cityscapes数据集上的实验表明,所提MCCL方法达到新的最优性能。源代码与模型已公开于https://github.com/NUST-Machine-Intelligence-Laboratory/MCCL。

原文摘要 · Abstract (English)

Consistency regularization has prevailed in semi-supervised semantic segmentation and achieved promising performance. However, existing methods typically concentrate on enhancing the Image-augmentation based Prediction consistency and optimizing the segmentation network as a whole, resulting in insufficient utilization of potential supervisory information. In this paper, we propose a Multi-Constraint Consistency Learning (MCCL) approach to facilitate the staged enhancement of the encoder and decoder. Specifically, we first design a feature knowledge alignment (FKA) strategy to promote the feature consistency learning of the encoder from image-augmentation. Our FKA encourages the encoder to derive consistent features for strongly and weakly augmented views from the perspectives of point-to-point alignment and prototype-based intra-class compactness. Moreover, we propose a self-adaptive intervention (SAI) module to increase the discrepancy of aligned intermediate feature representations, promoting Feature-perturbation based Prediction consistency learning. Self-adaptive feature masking and noise injection are designed in an instance-specific manner to perturb the features for robust learning of the decoder. Experimental results on Pascal VOC2012 and Cityscapes datasets demonstrate that our proposed MCCL achieves new state-of-the-art performance. The source code and models are made available at https://github.com/NUST-Machine-Intelligence-Laboratory/MCCL.

语义分割半监督一致性学习特征对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。