通过双向协作提升隐蔽目标分割在少标注下的表现。
SCALER: SAM-Enhanced Collaborative Learning for Label-Deficient Concealed Object Segmentation
- 交替优化分割器与可学习SAM,实现互补监督
- 在8个任务上均显著提升分割精度,尤其在弱监督下
- 适合资源受限场景,也适用于轻量与大模型
现有少标注隐蔽目标分割(LDCOS)方法依赖一致性约束或基于SAM的伪标签,但受限于目标隐蔽性和标注稀缺,性能仍不足。本文提出SCALER框架,探索一致性约束与SAM监督的联合利用,并研究分割器能否反向引导SAM实现相互优化。SCALER包含两个交替阶段:第一阶段固定SAM监督,采用基于熵的图像级和基于不确定性的像素级加权,筛选可靠伪标签区域并强化难样本;第二阶段通过增强不变性和抗噪损失更新SAM,利用其对扰动的鲁棒性。实验表明,SCALER在八个半监督与弱监督任务中均实现稳定提升,且可作为通用训练范式,有效增强轻量分割器与大基础模型在标注稀缺条件下的性能。代码将公开。
原文摘要 · Abstract (English)
Existing methods for label-deficient concealed object segmentation (LDCOS) either rely on consistency constraints or Segment Anything Model (SAM)-based pseudo-labeling. However, their performance remains limited due to the intrinsic concealment of targets and the scarcity of annotations. This study investigates two key questions: (1) Can consistency constraints and SAM-based supervision be jointly integrated to better exploit complementary information and enhance the segmenter? and (2) beyond that, can the segmenter in turn guide SAM through reciprocal supervision, enabling mutual improvement? To answer these questions, we present SCALER, a unified collaborative framework toward LDCOS that jointly optimizes a mean-teacher segmenter and a learnable SAM. SCALER operates in two alternating phases. In \textbf{Phase \uppercase\expandafter{\romannumeral1}}, the segmenter is optimized under fixed SAM supervision using entropy-based image-level and uncertainty-based pixel-level weighting to select reliable pseudo-label regions and emphasize harder examples. In \textbf{Phase \uppercase\expandafter{\romannumeral2}}, SAM is updated via augmentation invariance and noise resistance losses, leveraging its inherent robustness to perturbations. Experiments demonstrate that SCALER yields consistent performance gains across eight semi- and weakly-supervised COS tasks. The results further suggest that SCALER can serve as a general training paradigm to enhance both lightweight segmenters and large foundation models under label-scarce conditions. Code will be released.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。