arXiv:2606.05695cs.LG2026-06

改进原型回放策略,让模型在不存数据情况下持续学习新类别。

Revisiting Prototype Rehearsal for Exemplar-Free Continual Learning: Manifold-Aware Boundary Sampling with Adaptive Class-Balanced Loss

论文配图:Revisiting Prototype Rehearsal for Exemplar-Free Continual Learning: Manifold-Aware Boundary Sampling with Adaptive Class-Balanced Loss
图 1 · 摘自论文原文
  • 基于流形边界采样生成更贴近真实数据分布的旧类样本。
  • 动态调整损失权重,缓解新旧类别数据不平衡问题。
  • 在多个基准上达到顶尖性能,适合持续学习研究者使用。

无示例类增量学习(EFCIL)旨在不存储原始数据的情况下逐步学习新类别。传统原型回放通过在旧类原型附近采样并混合当前任务数据来缓解灾难性遗忘,但近年的漂移补偿方法表现更优,引发对回放机制是否本质受限的质疑。本文认为性能差距并非源于回放思想本身,而是其实现方式:现有方法将原型视为孤立的类别摘要,忽略邻近敌类信息,且无法纠正少量合成旧类样本与大量真实新类样本之间的严重失衡。为此,本文提出一种流形感知的原型回放方法:首先引入约束扩展过采样,将每个旧类原型朝最近的新类敌特征方向插值,生成边界感知的回放样本,更贴合数据流形并保持类间分离;其次设计自适应类别平衡损失,根据时间动态加权,强化早期原型的梯度贡献,随任务推进逐步减弱其影响。两者结合使原型回放具备抗漂移、抗失衡能力,在多个EFCIL基准上达到或超越最新漂移补偿方法,实现顶尖性能。

原文摘要 · Abstract (English)

Exemplar-free class-incremental learning (EFCIL) aims to acquire new classes over time without storing raw data. Historically, prototype rehearsal, which samples around stored class prototypes and mixes them with current-task data, has been a popular strategy to reduce catastrophic forgetting. However, recent drift-compensation methods that explicitly realign prototypes in the evolving feature space consistently outperform prototype-based rehearsal, raising the question of whether rehearsal itself is fundamentally limited. We argue that the performance gap stems not from the idea of prototype rehearsal per se, but from how it is typically instantiated: existing approaches treat prototypes as isolated class summaries that ignore information from nearby enemy classes, and fail to correct the emerging class imbalance between a handful of synthetic old-class samples and hundreds of real instances from newly introduced classes. Building on this hypothesis, we revisit prototype rehearsal and propose a manifold-aware variant that restores its competitiveness in EFCIL. First, we introduce Constrained Expansive Over-Sampling, which interpolates each old-class prototype toward its nearest enemy features from new classes, generating boundary-aware rehearsal samples that better follow the underlying data manifold while preserving inter-class separation. Second, we design an Adaptive Class-Balanced loss that performs time-based class weighting, amplifying gradients from older prototypes when they are most informative and gradually annealing their influence as richer supervision from later tasks accumulates. Together, these components turn prototype rehearsal into a drift-resilient, imbalance-aware mechanism that closes, and often reverses, the gap to recent drift-compensation methods, achieving state-of-the-art performance across multiple EFCIL benchmarks.

持续学习原型回放类别平衡流形感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。