arXiv:2504.20566cs.LGcs.AI2025-04

提出双分类器机制,实现在线增量学习中旧知识与新知识的平衡。

Balanced Online Class-Incremental Learning via Dual Classifiers

  • 采用双分类器设计,通过隐式知识迁移实现新旧类知识融合。
  • 在三个基准数据集上达到更均衡且优于现有方法的性能。
  • 适合需要持续学习新类别同时不遗忘旧类的应用场景。

在线类增量学习(OCIL)旨在单次遍历数据流中逐步学习新类别(即可塑性),同时保持对已学类别的知识(即稳定性)。其核心挑战在于持续更新模型时,如何平衡旧类与新类知识的掌握程度。现有方法多依赖经验回放进行显式知识交互,并采用训练分离以缓解偏差问题,但在持续集成知识方面仍存在困难,常导致可塑性下降或稳定性不足。本文提出一种基于回放的新方法——平衡包含式分离在线增量学习(BISON),通过双分类器的包含式训练分离策略,使新旧类知识能有效融入模型,同时引入隐式跨分类器知识迁移机制。在三个广泛使用的OCIL基准数据集上的大量实验表明,BISON相比当前最优回放类方法,实现了更均衡且更优的性能。

原文摘要 · Abstract (English)

Online class-incremental learning (OCIL) focuses on gradually learning new classes (called plasticity) from a stream of data in a single-pass, while concurrently preserving knowledge of previously learned classes (called stability). The primary challenge in OCIL lies in maintaining a good balance between the knowledge of old and new classes within the continually updated model. Most existing methods rely on explicit knowledge interaction through experience replay, and often employ exclusive training separation to address bias problems. Nevertheless, it still remains a big challenge to achieve a well-balanced learner, as these methods often exhibit either reduced plasticity or limited stability due to difficulties in continually integrating knowledge in the OCIL setting. In this paper, we propose a novel replay-based method, called Balanced Inclusive Separation for Online iNcremental learning (BISON), which can achieve both high plasticity and stability, thus ensuring more balanced performance in OCIL. Our BISON method proposes an inclusive training separation strategy using dual classifiers so that knowledge from both old and new classes can effectively be integrated into the model, while introducing implicit approaches for transferring knowledge across the two classifiers. Extensive experimental evaluations over three widely-used OCIL benchmark datasets demonstrate the superiority of BISON, showing more balanced yet better performance compared to state-of-the-art replay-based OCIL methods.

增量学习双分类器知识平衡

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。