新方法让模型持续识别新类别,同时不忘记旧类别。
Neighborhood Commonality-aware Evolution Network for Continuous Generalized Category Discovery
- 利用邻域共性引导学习新类别的区分特征
- 在CIFAR100上新类识别准确率领先第二名6.32%
- 适合需要长期学习新类别的实际场景
连续广义类别发现(C-GCD)旨在从无标签图像集中持续发现新类别,同时保持对旧类别的性能。本文提出一种名为邻域共性感知演化网络(NCENet)的新学习框架,从表征学习角度解决该问题。为学习新类别的判别表征,设计了邻域共性感知表征学习(NCRL),通过挖掘邻域的局部共性来引导不同类别实例间表征差异的学习。为维持旧类别的表征能力,设计双层对比知识蒸馏(BCKD)模块,利用对比学习感知学习过程与已学知识,并进行知识蒸馏。在CIFAR10、CIFAR100和Tiny-ImageNet上的大量实验表明,NCENet优于现有最先进方法。特别地,在CIFAR100的最后一个增量学习阶段,其在旧类上的聚类准确率比第二好方法高3.09%,在新类上高6.32%。代码将公开于https://github.com/xjtuYW/NCENet.git。
原文摘要 · Abstract (English)
Continuous Generalized Category Discovery (C-GCD) aims to continually discover novel classes from unlabelled image sets while maintaining performance on old classes. In this paper, we propose a novel learning framework, dubbed Neighborhood Commonality-aware Evolution Network (NCENet) that conquers this task from the perspective of representation learning. Concretely, to learn discriminative representations for novel classes, a Neighborhood Commonality-aware Representation Learning (NCRL) is designed, which exploits local commonalities derived neighborhoods to guide the learning of representational differences between instances of different classes. To maintain the representation ability for old classes, a Bi-level Contrastive Knowledge Distillation (BCKD) module is designed, which leverages contrastive learning to perceive the learning and learned knowledge and conducts knowledge distillation. Extensive experiments conducted on CIFAR10, CIFAR100, and Tiny-ImageNet demonstrate the superior performance of NCENet compared to the previous state-of-the-art method. Particularly, in the last incremental learning session on CIFAR100, the clustering accuracy of NCENet outperforms the second-best method by a margin of 3.09\% on old classes and by a margin of 6.32\% on new classes. Our code will be publicly available at \href{https://github.com/xjtuYW/NCENet.git}{https://github.com/xjtuYW/NCENet.git}. \end{abstract}
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。