arXiv:2604.02765cs.LG2026-04

提出自由流动的类别增量学习,应对不规则新增类别的挑战。

Free-Flow Class-Incremental Learning: Towards Robust CIL under Variable Class Arrivals

  • 用类别均值代替实例损失聚合,提升统计可靠性。
  • 根据增量规模动态调整新类权重,稳定分类器性能。
  • 无需修改主干模型,适用于各类预训练方法,适合真实场景。

类别增量学习(CIL)通常在预设的固定或近似均等的类别增量下评估,而实际系统可能需在新类别出现时随时更新,无需强制平衡任务划分。本文将此设定正式定义为自由流动类别增量学习(FFCIL),其中各阶段新增类别数量可显著变化。我们发现,变量类到达会改变增量训练的类别构成、新类分类器统计的可靠性以及跨增量学习表示的一致性,导致传统与基于预训练模型(PTM)的方法性能明显下降。为此,我们提出一个通用框架:类均值(CWM),以类别平均替代实例级损失聚合;动态干预权重对齐(DIWA),根据当前增量规模调整新类权重校准;头无关对齐(HA),通过当前与历史类特征监督对PTM方法进行特征级修正。在多种方法、数据集和类别到达模式下的实验表明,FFCIL具有普遍影响,且该框架始终有效。

原文摘要 · Abstract (English)

Class-incremental learning (CIL) is commonly evaluated under predefined schedules with fixed or nearly equal class increments, leaving irregular class-arrival scenarios underexplored. However, practical CIL systems may need to update whenever new categories emerge, without forcing them into balanced task partitions. We formalize this setting as Free-Flow Class-Incremental Learning (FFCIL), where the number of newly arriving classes can vary substantially across learning stages. We show that variable class arrivals alter the class composition of incremental training, the reliability of new-class classifier statistics, and the consistency of representations learned across increments, causing clear performance degradation in both conventional and pre-trained model (PTM)-based CIL methods. To improve robustness under FFCIL, we introduce a general framework consisting of Class-Wise Mean (CWM), which replaces instance-wise loss aggregation with class-wise averaging; Dynamic Intervention Weight Alignment (DIWA), which adjusts new-class weight calibration according to the current increment size; and Head-Agnostic Alignment (HA), which performs feature-level correction for PTM-based methods using current and previous-class feature supervision. Extensive experiments across diverse methods, datasets, and class-arrival schedules demonstrate the general impact of FFCIL and the consistent effectiveness of our framework.

增量学习类别增量鲁棒性预训练模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。