arXiv:2510.12107cs.CV2025-10

提出DRL框架,解决增量学习中表示不连续与优化不一致问题

DRL: Discriminative Representation Learning with Parallel Adapters for Class Incremental Learning

  • 用并行适配器逐步扩展模型,轻量更新实现高效增量学习
  • 在6个基准上持续超越现有方法,训练推理效率高
  • 通过解耦锚点监督提升特征判别性,适合长期增量场景

基于预训练模型(PTM)强大的表征能力,非回放类增量学习(CIL)取得显著进展。然而,仍面临三大挑战:模型复杂度持续增长、增量过程中的表示不连续转移,以及阶段优化与全局推理之间的不一致。本文提出判别性表征学习(DRL)框架来针对性解决这些问题。DRL的网络结构称为增量并行适配器(IPA),基于PTM构建,每阶段仅以少量参数代价学习一个轻量适配器,实现高效扩展。适配器通过并行连接与转移门,继承并传递当前模型的表征能力,保障不同阶段间表示平滑过渡。为缓解不一致问题,设计解耦锚点监督(DAS),分别将正负样本与虚拟锚点比较,促进判别性表征学习,并对齐各阶段特征空间,缩小局部优化与全局推理间的差距。在六个基准上的大量实验表明,所提DRL在整个增量学习周期内持续优于现有最优方法,且在训练与推理阶段均保持高效率。

原文摘要 · Abstract (English)

With the excellent representation capabilities of Pre-Trained Models (PTMs), remarkable progress has been made in non-rehearsal Class-Incremental Learning (CIL) research. However, it remains an extremely challenging task due to three conundrums: increasingly large model complexity, non-smooth representation shift during incremental learning and inconsistency between stage-wise sub-problem optimization and global inference. In this work, we propose the Discriminative Representation Learning (DRL) framework to specifically address these challenges. To conduct incremental learning effectively and yet efficiently, the DRL's network, called Incremental Parallel Adapter (IPA) network, is built upon a PTM and increasingly augments the model by learning a lightweight adapter with a small amount of parameter learning overhead in each incremental stage. The adapter is responsible for adapting the model to new classes, it can inherit and propagate the representation capability from the current model through parallel connection between them by a transfer gate. As a result, this design guarantees a smooth representation shift between different incremental stages. Furthermore, to alleviate inconsistency and enable comparable feature representations across incremental stages, we design the Decoupled Anchor Supervision (DAS). It decouples constraints of positive and negative samples by respectively comparing them with the virtual anchor. This decoupling promotes discriminative representation learning and aligns the feature spaces learned at different stages, thereby narrowing the gap between stage-wise local optimization over a subset of data and global inference across all classes. Extensive experiments on six benchmarks reveal that our DRL consistently outperforms other state-of-the-art methods throughout the entire CIL period while maintaining high efficiency in both training and inference phases.

增量学习表征学习适配器判别性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。