提出新框架Happy,解决持续发现新类别时遗忘旧类的问题。
Happy: A Debiased Learning Framework for Continual Generalized Category Discovery
- 用聚类初始化和软熵正则化缓解预测偏差
- 通过难易感知原型采样降低遗忘,尤其提升困难类识别
- 适合长期持续学习场景,无需存储旧数据
在动态环境中持续发现新概念至关重要。本文研究尚待探索的持续广义类别发现(C-GCD)任务,即在不存储历史样本的前提下,从无标签数据中增量发现新类别并保持对旧类别的识别能力。现有设置难以反映真实场景,因此我们提出更贴近实际的C-GCD设定:在更长周期内发现更多新类。模型先在已知类的有标签数据上训练,随后多个增量阶段接收包含旧类与新类的无标签数据。核心挑战在于发现新类与防止遗忘旧类之间的冲突。我们分析发现模型存在预测偏差与难易偏差。为此提出去偏学习框架Happy,包含难易感知原型采样和软熵正则化。针对预测偏差,采用聚类引导初始化以获得鲁棒特征,并引入软熵正则化为新类分配合理概率,显著提升新类聚类效果。针对难易偏差,提出难易感知原型采样机制,有效缓解旧类遗忘,特别是对困难类。实验表明,该方法在多种数据集上均表现优异,在ImageNet-100上实现7.5%的整体性能提升。代码已公开于https://github.com/mashijie1028/Happy-CGCD。
原文摘要 · Abstract (English)
Constantly discovering novel concepts is crucial in evolving environments. This paper explores the underexplored task of Continual Generalized Category Discovery (C-GCD), which aims to incrementally discover new classes from unlabeled data while maintaining the ability to recognize previously learned classes. Although several settings are proposed to study the C-GCD task, they have limitations that do not reflect real-world scenarios. We thus study a more practical C-GCD setting, which includes more new classes to be discovered over a longer period, without storing samples of past classes. In C-GCD, the model is initially trained on labeled data of known classes, followed by multiple incremental stages where the model is fed with unlabeled data containing both old and new classes. The core challenge involves two conflicting objectives: discover new classes and prevent forgetting old ones. We delve into the conflicts and identify that models are susceptible to prediction bias and hardness bias. To address these issues, we introduce a debiased learning framework, namely Happy, characterized by Hardness-aware prototype sampling and soft entropy regularization. For the prediction bias, we first introduce clustering-guided initialization to provide robust features. In addition, we propose soft entropy regularization to assign appropriate probabilities to new classes, which can significantly enhance the clustering performance of new classes. For the harness bias, we present the hardness-aware prototype sampling, which can effectively reduce the forgetting issue for previously seen classes, especially for difficult classes. Experimental results demonstrate our method proficiently manages the conflicts of C-GCD and achieves remarkable performance across various datasets, e.g., 7.5% overall gains on ImageNet-100. Our code is publicly available at https://github.com/mashijie1028/Happy-CGCD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。