arXiv:2410.13285cs.CV2024-10被引 1

通过概念分解提升未知类别发现能力,让模型更懂已知类别的深层含义。

Composing Novel Classes: A Concept-Driven Approach to Generalized Category Discovery

  • 将已知类概念分为可推导与不可推导两类,分阶段学习以更好挖掘知识
  • 在多个基准数据集上优于现有最先进方法,提升显著且稳定
  • 适合研究类别发现、概念学习或需要跨类别泛化的任务

我们解决广义类别发现(GCD)问题,即在无标签数据集中利用已知类别知识发现新类别。现有方法依赖共享表示空间,但实验表明,仅用预训练的已知类特征空间即可实现新类别的优异聚类效果,说明已有方法未能充分挖掘已知类知识。为此,我们提出概念驱动的GCD框架ConceptGCD,将概念分为可从已知类推导和不可推导两类,并采用分阶段学习策略分别建模。首先通过已知类预训练模型提取概念,再通过生成层结合协方差增强损失生成可推导概念;随后扩展生成层,以概念得分归一化策略平衡学习不可推导概念,并引入对比损失保留已有概念。在多个基准数据集上的大量实验表明,该方法显著优于现有最先进方法。代码即将发布。

原文摘要 · Abstract (English)

We tackle the generalized category discovery (GCD) problem, which aims to discover novel classes in unlabeled datasets by leveraging the knowledge of known classes. Previous works utilize the known class knowledge through shared representation spaces. Despite their progress, our analysis experiments show that novel classes can achieve impressive clustering results on the feature space of a known class pre-trained model, suggesting that existing methods may not fully utilize known class knowledge. To address it, we introduce a novel concept learning framework for GCD, named ConceptGCD, that categorizes concepts into two types: derivable and underivable from known class concepts, and adopts a stage-wise learning strategy to learn them separately. Specifically, our framework first extracts known class concepts by a known class pre-trained model and then produces derivable concepts from them by a generator layer with a covariance-augmented loss. Subsequently, we expand the generator layer to learn underivable concepts in a balanced manner ensured by a concept score normalization strategy and integrate a contrastive loss to preserve previously learned concepts. Extensive experiments on various benchmark datasets demonstrate the superiority of our approach over the previous state-of-the-art methods. Code will be available soon.

类别发现概念学习无监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。