arXiv:2506.22505cs.CVcs.LG2025-06

用图像级标签训练模型实现弱监督目标分割,无需像素级标注。

Weakly Supervised Object Segmentation by Background Conditional Divergence

  • 通过背景条件差异构建反事实图像对,增强分割模型区分能力。
  • 在侧扫和声纳图像上优于无监督基线,自然图像也表现良好。
  • 无需预训练、生成网络或对抗判别器,适合数据稀缺领域。

在缺乏大量标注数据的专用图像领域(如合成孔径声呐、遥感、生物医学成像),自动目标分割仍具挑战性。获取像素级分割掩码成本高昂。本文提出一种方法,仅使用图像级存在/不存在标签(弱监督)训练掩码网络进行二值目标分割,该标签信息较少但可快速获取。核心思路是将分割出的目标置于纯背景图像中,生成具有反事实背景的逼真图像。为强化原图与反事实图之间的对比,先对纯背景图像聚类,训练时将目标从原始背景迁移至目标聚类中的背景。损失函数包含两部分:反事实图像与目标聚类真实图像间的分布差异,以及纯背景图像的监督损失。不采用对抗判别器,而是使用基于样本的分布差异度量。实验在侧扫和合成孔径声呐图像上验证了方法的有效性,显著优于仅在自然图像测试的无监督分割基线。进一步扩展到自然图像,不依赖预训练网络、生成网络或对抗判别器,仍获得合理性能。代码已开源。

原文摘要 · Abstract (English)

As a computer vision task, automatic object segmentation remains challenging in specialized image domains without massive labeled data, such as synthetic aperture sonar images, remote sensing, biomedical imaging, etc. In any domain, obtaining pixel-wise segmentation masks is expensive. In this work, we propose a method for training a masking network to perform binary object segmentation using weak supervision in the form of image-wise presence or absence of an object of interest, which provides less information but may be obtained more quickly from manual or automatic labeling. A key step in our method is that the segmented objects can be placed into background-only images to create realistic images of the objects with counterfactual backgrounds. To create a contrast between the original and counterfactual background images, we propose to first cluster the background-only images and then, during learning, create counterfactual images that blend objects segmented from their original source backgrounds to backgrounds chosen from a targeted cluster. One term in the training loss is the divergence between these counterfactual images and the real object images with backgrounds of the target cluster. The other term is a supervised loss for background-only images. While an adversarial critic could provide the divergence, we use sample-based divergences. We conduct experiments on side-scan and synthetic aperture sonar in which our approach succeeds compared to previous unsupervised segmentation baselines that were only tested on natural images. Furthermore, to show generality we extend our experiments to natural images, obtaining reasonable performance with our method that avoids pretrained networks, generative networks, and adversarial critics. The code for this work can be found at \href{GitHub}{https://github.com/bakerhassan/WSOS}.

弱监督目标分割反事实学习声呐图像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。