arXiv:2505.10781cs.CVcs.AI2025-05被引 3

仅用图像标签实现增量分割,解决标注成本高的难题

Completely Weakly Supervised Class-Incremental Learning for Semantic Segmentation

  • 用定位器与基础模型的不确定性融合生成鲁棒伪标签
  • 在15-5和10-10 VOC设置下超越部分弱监督方法
  • 适合标注资源有限但需持续学习新类别的场景

本文提出一种完全弱监督的类别增量语义分割方法,仅使用图像级标签即可学习基础类和新增类的分割。传统类别增量分割(CISS)依赖昂贵的像素级标注,虽已有部分弱监督方法,但本文首次实现完全弱监督下的CISS。通过融合定位器与一系列基础模型的伪标签并依据其不确定性进行筛选,生成更鲁棒的伪标签;为缓解灾难性遗忘,引入示例引导的数据增强,生成同时包含旧类与新类的多样化图像。在15-5 VOC、10-10 VOC及COCO-to-VOC三个常见设置下,分别测试不相交与重叠两类场景。实验表明,在15-5与10-10 VOC设置中,该方法性能优于部分弱监督方法,且在COCO-to-VOC设置中达到可比精度。

原文摘要 · Abstract (English)

This work addresses the task of completely weakly supervised class-incremental learning for semantic segmentation to learn segmentation for both base and additional novel classes using only image-level labels. While class-incremental semantic segmentation (CISS) is crucial for handling diverse and newly emerging objects in the real world, traditional CISS methods require expensive pixel-level annotations for training. To overcome this limitation, partially weakly-supervised approaches have recently been proposed. However, to the best of our knowledge, this is the first work to introduce a completely weakly-supervised method for CISS. To achieve this, we propose to generate robust pseudo-labels by combining pseudo-labels from a localizer and a sequence of foundation models based on their uncertainty. Moreover, to mitigate catastrophic forgetting, we introduce an exemplar-guided data augmentation method that generates diverse images containing both previous and novel classes with guidance. Finally, we conduct experiments in three common experimental settings: 15-5 VOC, 10-10 VOC, and COCO-to-VOC, and in two scenarios: disjoint and overlap. The experimental results demonstrate that our completely weakly supervised method outperforms even partially weakly supervised methods in the 15-5 VOC and 10-10 VOC settings while achieving competitive accuracy in the COCO-to-VOC setting.

增量学习弱监督语义分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。