arXiv:2512.21845cs.CVcs.LG2025-12

提出动态扩展框架,解决增量学习中类别错位与特征漂移问题

Scalable Class-Incremental Learning Based on Parametric Neural Collapse

  • 基于参数化神经坍缩,动态构建可扩展的ETF分类器
  • 通过自适应层和知识蒸馏,保持旧类特征一致性
  • 支持低开销扩展,适合真实场景中持续增加类别

增量学习常面临新数据过拟合与旧知识灾难性遗忘的问题。现有方法虽能冻结旧模型参数扩展新任务,却忽视结构效率,导致模块间特征差异及类别分布演化引发的类别错位。为此,本文提出基于参数化神经坍缩的可扩展类别增量学习(SCL-PNC),通过自适应层实现按需、低成本的主干网络扩展,并根据增量类别动态调整等角紧框架(ETF)结构。该方法能高效应对真实场景中类别数量增长带来的扩展挑战。为缓解串行扩展中的特征漂移,提出并行扩展框架,结合知识蒸馏算法对齐各扩展模块的特征表示。SCL-PNC不仅设计了动态可扩展的ETF分类器以解决类别错位,还通过自适应层与模块间知识蒸馏保障特征一致性。借助神经坍缩机制,通过可扩展主干、自适应层与参数化ETF分类器的结构化组合,引导增量扩展模型收敛。在标准基准上的实验验证了该方法的有效性与高效性。代码已开源:https://github.com/zhangchuangxin71-cyber/dynamic_ETF2。

原文摘要 · Abstract (English)

Incremental learning often encounter challenges such as overfitting to new data and catastrophic forgetting of old data. Existing methods can effectively extend the model for new tasks while freezing the parameters of the old model, but ignore the necessity of structural efficiency to lead to the feature difference between modules and the class misalignment due to evolving class distributions. To address these issues, we propose scalable class-incremental learning based on parametric neural collapse (SCL-PNC) that enables demand-driven, minimal-cost backbone expansion by adapt-layer and refines the static into a dynamic parametric Equiangular Tight Frame (ETF) framework according to incremental class. This method can efficiently handle the model expansion question with the increasing number of categories in real-world scenarios. Additionally, to counteract feature drift in serial expansion models, the parallel expansion framework is presented with a knowledge distillation algorithm to align features across expansion modules. Therefore, SCL-PNC can not only design a dynamic and extensible ETF classifier to address class misalignment due to evolving class distributions, but also ensure feature consistency by an adapt-layer with knowledge distillation between extended modules. By leveraging neural collapse, SCL-PNC induces the convergence of the incremental expansion model through a structured combination of the expandable backbone, adapt-layer, and the parametric ETF classifier. Experiments on standard benchmarks demonstrate the effectiveness and efficiency of our proposed method. Our code is available at https://github.com/zhangchuangxin71-cyber/dynamic_ ETF2. Keywords: Class incremental learning; Catastrophic forgetting; Neural collapse;Knowledge distillation; Expanded model.

增量学习神经坍缩动态扩展知识蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。