arXiv:2503.22136cs.CV2025-03CVPR被引 12

解决持续语义分割中旧类别背景混淆问题,提升模型长期学习能力

Beyond Background Shift: Rethinking Instance Replay in Continual Semantic Segmentation

  • 用实例存储替代图像存储,避免旧类别的标注混淆
  • 通过融合旧实例与新图像,缓解新旧图像间的背景偏移
  • 适合需要长期学习新类别的视觉场景应用

本文研究持续语义分割(CSS),即模型需在不遗忘旧类别知识的前提下持续学习新类别。尽管在分类任务中回放旧图像可有效缓解灾难性遗忘,但在CSS中,旧图像与新图像的局部标注会引发未标注类别与背景的混淆,影响模型拟合。为此,本文提出增强型实例回放(EIR)方法:通过存储旧类别的实例,不仅保留旧知识,还消除背景混淆;同时将存储实例与新图像融合,缓解新图像中的背景偏移。该方法有效解决了新旧图像中的背景差异问题,显著缓解了灾难性遗忘。实验表明,EIR在多个基准上显著优于当前最优方法。

原文摘要 · Abstract (English)

In this work, we focus on continual semantic segmentation (CSS), where segmentation networks are required to continuously learn new classes without erasing knowledge of previously learned ones. Although storing images of old classes and directly incorporating them into the training of new models has proven effective in mitigating catastrophic forgetting in classification tasks, this strategy presents notable limitations in CSS. Specifically, the stored and new images with partial category annotations leads to confusion between unannotated categories and the background, complicating model fitting. To tackle this issue, this paper proposes a novel Enhanced Instance Replay (EIR) method, which not only preserves knowledge of old classes while simultaneously eliminating background confusion by instance storage of old classes, but also mitigates background shifts in the new images by integrating stored instances with new images. By effectively resolving background shifts in both stored and new images, EIR alleviates catastrophic forgetting in the CSS task, thereby enhancing the model's capacity for CSS. Experimental results validate the efficacy of our approach, which significantly outperforms state-of-the-art CSS methods.

持续学习语义分割实例回放背景混淆

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。