arXiv:2605.12451cs.CV2026-05

提出新框架让模型提前为未来类别留出空间,提升持续分割性能

FuTCR: Future-Targeted Contrast and Repulsion for Continual Panoptic Segmentation

论文配图:FuTCR: Future-Targeted Contrast and Repulsion for Continual Panoptic Segmentation
图 1 · 摘自论文原文
  • 通过预测前景类别的背景区域,提前构建未来类别原型
  • 对比增强与排斥机制使模型区分背景与新类别,新类识别率最高提升28%
  • 适合需要长期学习新类别的视觉系统,如自动驾驶场景

持续全景分割(CPS)要求模型能快速适应新增类别。由于训练图像中常混合标注与未标注目标,现有方法通常将所有未标注像素归入单一‘背景’类,导致模型误认为不同背景类别相同。这使得后续学习新类别时难以利用曾被忽略的特征。为此,本文提出未来目标对比与排斥(FuTCR)框架,在新类别引入前重构表征。FuTCR首先识别模型预测为背景但具有非背景得分的像素区域,作为潜在未来类别;接着通过像素-区域对比构建一致原型,并同时将背景特征从已知类别原型中排斥,显式为未来类别预留表示空间。在六种CPS设置及多种数据集规模下实验表明,该方法相比当前最优模型,新类别全景分割质量最高提升28%,基类性能保持或提升最多4%。

原文摘要 · Abstract (English)

Continual Panoptic Segmentation (CPS) requires methods that can quickly adapt to new categories over time. The nature of this dense prediction task means that training images may contain a mix of labeled and unlabeled objects. As nothing is known about these unlabeled objects a priori, existing methods often simply group any unlabeled pixel into a single "background" class during training. In effect, during training, they repeatedly tell the model that all the different background categories are the same (even when they aren't). This makes learning to identify different background categories as they are added challenging since these new categories may require using information the model was previously told was unimportant and ignored. Thus, we propose a Future-Targeted Contrastive and Repulsive (FuTCR) framework that addresses this limitation by restructuring representations before new classes are introduced. FuTCR first discovers confident future-like regions by grouping model-predicted masks whose pixels are consistently classified as background but exhibit non-background logits. Next, FuTCR applies pixel-to-region contrast to build coherent prototypes from these unlabeled regions, while simultaneously repelling background features away from known-class prototypes to explicitly reserve representational space for future categories. Experiments across six CPS settings and a range of dataset sizes show FuTCR improves relative new-class panoptic quality over the state-of-the-art by up to 28%, while preserving or improving base-class performance with gains up to 4%.

持续学习全景分割表征预留对比学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。