提出统一适配器框架,解决任务类别数量不均带来的学习偏差问题。
One Adapter for All: Towards Unified Representation in Step-Imbalanced Class-Incremental Learning
- 用单一适配器动态融合不同规模任务更新,保持推理开销恒定。
- 在多数据集上实现与现有方法相当的准确率,且推理成本显著更低。
- 适合需要高效部署、应对动态任务规模的持续学习场景。
类别增量学习(CIL)旨在随时间学习新类别同时保留旧知识,但多数设定和方法假设任务流中各类别数量均衡。现实中,每轮任务包含的类别数常存在显著差异,称为“步长不平衡”:大任务主导学习过程,小任务引入不稳定更新。现有方法因假设任务平衡,对所有任务一视同仁,导致更新失衡,损害整体性能。为此,我们提出 One-A,一种统一且具备不平衡感知能力的框架,将任务更新逐步合并为单一适配器,维持恒定推理成本。One-A采用非对称子空间对齐,在保留大任务主导子空间的同时约束低信息量更新;信息自适应加权平衡基础与新增适配器贡献;方向性门控机制沿各奇异方向选择性融合更新,保持头部方向稳定、尾部方向可塑。在多个基准和步长不平衡流上,One-A取得具有竞争力的准确率,且推理开销显著降低,证明单一、非对称融合的适配器可兼具对动态任务规模的适应性与部署效率。
原文摘要 · Abstract (English)
Class-incremental learning (CIL) aims to acquire new classes over time while retaining prior knowledge, yet most setups and methods assume balanced task streams. In practice, the number of classes per task often varies significantly. We refer to this as step imbalance, where large tasks that contain more classes dominate learning and small tasks inject unstable updates. Existing CIL methods assume balanced tasks and therefore treat all tasks uniformly, producing imbalanced updates that degrade overall learning performance. To address this challenge, we propose One-A, a unified and imbalance-aware framework that incrementally merges task updates into a single adapter, maintaining constant inference cost. One-A performs asymmetric subspace alignment to preserve dominant subspaces learned from large tasks while constraining low-information updates within them. An information-adaptive weighting balances the contribution between base and new adapters, and a directional gating mechanism selectively fuses updates along each singular direction, maintaining stability in head directions and plasticity in tail ones. Across multiple benchmarks and step-imbalanced streams, One-A achieves competitive accuracy with significantly low inference overhead, showing that a single, asymmetrically fused adapter can remain both adaptive to dynamic task sizes and efficient at deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。