arXiv:2503.17677cs.LG2025-03CVPR被引 7

提出新方法减少增量学习中类别混淆,提升模型持续学习能力。

Reducing Class-wise Confusion for Incremental Learning with Disentangled Manifolds

  • 用轻量自编码器在潜在空间学习每个类的紧凑流形,增强表征稳定性。
  • 设计混淆感知分离损失,使同类特征聚拢、异类特征远离,降低混淆。
  • 在多个数据集上效果优于当前最优方法,最高提升5.41%。

类增量学习(CIL)旨在让模型在不灾难性遗忘旧类的前提下持续学习新类。一种有前景的方向是学习并利用类原型进行增量更新。尽管方法简单直观,我们发现此类方法存在表征能力不足和特征重叠不充分的问题,导致类别混淆和性能受限。本文提出一种去混淆自编码器分类器(CREATE)。具体地,采用轻量级自编码器模块,在潜在子空间中为每类学习紧凑流形,仅允许样本在语义正确的自编码器上被良好重构。这增强了类分布的表征稳定性和能力,缓解了类别混淆问题。为进一步区分重叠特征,提出混淆感知潜在空间分离损失,确保样本在其对应低维流形内紧密聚集,同时远离其他类的特征分布。实验表明,通过学习解耦流形,该方法显著提升表征能力和判别能力,有效降低类别混淆。在多个数据集和设置下,相比现有最优方法,性能提升最高达5.41%。

原文摘要 · Abstract (English)

Class incremental learning (CIL) aims to enable models to continuously learn new classes without catastrophically forgetting old ones. A promising direction is to learn and use prototypes of classes during incremental updates. Despite simplicity and intuition, we find that such methods suffer from inadequate representation capability and unsatisfied feature overlap. These two factors cause class-wise confusion and limited performance. In this paper, we develop a Confusion-REduced AuTo-Encoder classifier (CREATE) for CIL. Specifically, our method employs a lightweight auto-encoder module to learn compact manifold for each class in the latent subspace, constraining samples to be well reconstructed only on the semantically correct auto-encoder. Thus, the representation stability and capability of class distributions are enhanced, alleviating the potential class-wise confusion problem. To further distinguish the overlapped features, we propose a confusion-aware latent space separation loss that ensures samples are closely distributed in their corresponding low-dimensional manifold while keeping away from the distributions of features from other classes. Our method demonstrates stronger representational capacity and discrimination ability by learning disentangled manifolds and reduces class confusion. Extensive experiments on multiple datasets and settings show that CREATE outperforms other state-of-the-art methods up to 5.41%.

增量学习类别混淆自编码器表征学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。