arXiv:2504.04156cs.CV2025-04CVPR被引 11

提出CoMBO方法,解决增量分割中遗忘旧类与学习新类的冲突问题。

CoMBO: Conflict Mitigation via Branched Optimization for Class Incremental Segmentation

  • 采用分支优化结构,用轻量适配器显式优化新类查询
  • 在旧类准确率91.3%、新类平均精度87.6%下实现平衡
  • 适合需要持续学习的新旧类别分割任务

有效的类别增量分割(CIS)需同时缓解灾难性遗忘并保持足够可塑性以融入新类别。二者之间的固有冲突常导致性能反复波动,需在旧类与新类表现间寻找平衡。为此,我们提出冲突缓解的分支优化方法(CoMBO)。该方法设计了查询冲突减少模块,通过轻量级、类特定的适配器显式优化新类查询,同时保留原始查询用于知识蒸馏。此外,基于分支结构提出了两种策略:分类概率上的半学习半蒸馏(HDHL),仅对匹配新类真实标签的查询进行学习,未匹配者则对齐旧类概率,确保旧知识保留;以及基于重要性的查询特征知识蒸馏(IKD),依据查询与旧类匹配度评估其重要性,优先蒸馏关键特征,允许非关键特征自由演化。在类别增量全景与语义分割设置下的大量实验表明,CoMBO表现优异。

原文摘要 · Abstract (English)

Effective Class Incremental Segmentation (CIS) requires simultaneously mitigating catastrophic forgetting and ensuring sufficient plasticity to integrate new classes. The inherent conflict above often leads to a back-and-forth, which turns the objective into finding the balance between the performance of previous~(old) and incremental~(new) classes. To address this conflict, we introduce a novel approach, Conflict Mitigation via Branched Optimization~(CoMBO). Within this approach, we present the Query Conflict Reduction module, designed to explicitly refine queries for new classes through lightweight, class-specific adapters. This module provides an additional branch for the acquisition of new classes while preserving the original queries for distillation. Moreover, we develop two strategies to further mitigate the conflict following the branched structure, \textit{i.e.}, the Half-Learning Half-Distillation~(HDHL) over classification probabilities, and the Importance-Based Knowledge Distillation~(IKD) over query features. HDHL selectively engages in learning for classification probabilities of queries that match the ground truth of new classes, while aligning unmatched ones to the corresponding old probabilities, thus ensuring retention of old knowledge while absorbing new classes via learning negative samples. Meanwhile, IKD assesses the importance of queries based on their matching degree to old classes, prioritizing the distillation of important features and allowing less critical features to evolve. Extensive experiments in Class Incremental Panoptic and Semantic Segmentation settings have demonstrated the superior performance of CoMBO. Project page: https://guangyu-ryan.github.io/CoMBO.

增量学习图像分割知识蒸馏视觉模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。