arXiv:2412.12669cs.CV2024-12中稿 · AAAI被引 8

提出自适应原型重放机制,解决旧类知识遗忘问题。

Adaptive Prototype Replay for Class Incremental Semantic Segmentation

  • 动态更新存储原型以匹配新表示,缓解表征不匹配问题
  • 在Pascal VOC和ADE20K上达到当前最佳性能,多步场景效果显著
  • 适合持续学习中需长期保留旧类语义分割的场景

类别增量语义分割(CISS)旨在持续学习新类别同时避免遗忘旧知识。现有方法通过存储原型或特征进行分布重放以缓解灾难性遗忘,但忽略了关键问题:在CISS中,旧类表征随增量学习不断更新,而原型重放策略使用固定原型,导致表征与原型不匹配,降低重放效果。为此,本文提出自适应原型重放(Adapter),包含自适应偏差补偿(ADC)策略和不确定性感知约束(UAC)损失。ADC动态调整存储原型,以匹配旧类表征的更新距离;UAC损失降低预测不确定性,聚合判别性特征以生成紧凑原型。此外引入基于补偿的原型相似性判别(CPD)损失,增强相似原型间的区分度,提升重放效率。在Pascal VOC和ADE20K数据集上的大量实验表明,Adapter在多种CISS任务中表现优异,尤其在多步场景下效果突出。代码与模型已开源。

原文摘要 · Abstract (English)

Class incremental semantic segmentation (CISS) aims to segment new classes during continual steps while preventing the forgetting of old knowledge. Existing methods alleviate catastrophic forgetting by replaying distributions of previously learned classes using stored prototypes or features. However, they overlook a critical issue: in CISS, the representation of class knowledge is updated continuously through incremental learning, whereas prototype replay methods maintain fixed prototypes. This mismatch between updated representation and fixed prototypes limits the effectiveness of the prototype replay strategy. To address this issue, we propose the Adaptive prototype replay (Adapter) for CISS in this paper. Adapter comprises an adaptive deviation compen sation (ADC) strategy and an uncertainty-aware constraint (UAC) loss. Specifically, the ADC strategy dynamically updates the stored prototypes based on the estimated representation shift distance to match the updated representation of old class. The UAC loss reduces prediction uncertainty, aggregating discriminative features to aid in generating compact prototypes. Additionally, we introduce a compensation-based prototype similarity discriminative (CPD) loss to ensure adequate differentiation between similar prototypes, thereby enhancing the efficiency of the adaptive prototype replay strategy. Extensive experiments on Pascal VOC and ADE20K datasets demonstrate that Adapter achieves state-of-the-art results and proves effective across various CISS tasks, particularly in challenging multi-step scenarios. The code and model is available at https://github.com/zhu-gl-ux/Adapter.

语义分割增量学习原型重放

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。