将边界检测融入半监督分割,提升模型对边缘的感知能力。
BoundMatch: Boundary detection applied to semi-supervised segmentation
- 在师生一致性框架中加入边界检测任务,双任务协同优化
- 在Cityscapes上用DINOv2模型达最新性能,边界指标显著提升
- 适合需要精准边缘分割的场景,如自动驾驶与移动端部署
半监督语义分割旨在利用大量未标注图像和少量标注数据,缓解密集像素标注的负担。现有的一致性正则化方法虽表现优异,但大多未将边界作为独立学习目标。本文提出BoundMatch,一种新型多任务半监督分割框架,将语义边界检测显式集成到师生一致性正则化流程中。核心机制为边界一致性正则化多任务学习(BCRM),强制师生模型在分割掩码和详细语义边界上达成预测一致,实现两个独立任务的互补监督。为进一步提升性能并生成更清晰的边界,引入两个轻量级融合模块:边界-语义融合(BSF)将学习到的边界线索注入分割解码器,空间梯度融合(SGF)利用掩码梯度优化边界预测,生成更可靠的边界伪标签。该框架基于SAMTH,一种强基线教师-学生结构,采用和谐批归一化(HBN)更新策略以增强稳定性。在Cityscapes、Pascal VOC等多样化数据集上的大量实验表明,BoundMatch在多个指标上达到当前最优水平。特别地,在新提出的Cityscapes基准上使用DINOv2基础模型取得领先结果。消融实验证明,该方法能有效提升边界相关评估指标,在大规模真实未标注数据场景下表现稳健,并适用于轻量化架构用于移动部署。
原文摘要 · Abstract (English)
Semi-supervised semantic segmentation (SS-SS) aims to mitigate the heavy annotation burden of dense pixel labeling by leveraging abundant unlabeled images alongside a small labeled set. While current consistency regularization methods achieve strong results, most do not explicitly model boundaries as a separate learning objective. In this paper, we propose BoundMatch, a novel multi-task SS-SS framework that explicitly integrates semantic boundary detection into a teacher-student consistency regularization pipeline. Our core mechanism, Boundary Consistency Regularized Multi-Task Learning (BCRM), enforces prediction agreement between teacher and student models on both segmentation masks and detailed semantic boundaries, providing complementary supervision from two independent tasks. To further enhance performance and encourage sharper boundaries, BoundMatch incorporates two lightweight fusion modules: Boundary-Semantic Fusion (BSF) injects learned boundary cues into the segmentation decoder, while Spatial Gradient Fusion (SGF) refines boundary predictions using mask gradients, yielding more reliable boundary pseudo-labels. This framework is built upon SAMTH, a strong teacher-student baseline featuring a Harmonious Batch Normalization (HBN) update strategy for improved stability. Extensive experiments on diverse datasets including Cityscapes and Pascal VOC show that BoundMatch achieves competitive performance against current state-of-the-art methods. Our approach achieves state-of-the-art results on the new Cityscapes benchmark with DINOv2 foundation model. Ablation studies highlight BoundMatch's ability to improve boundary-specific evaluation metrics, its effectiveness in realistic large-scale unlabeled data scenario, and applicability to lightweight architectures for mobile deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。