arXiv:2509.26227cs.CV2025-09IJCV被引 3

提出多粒度概念专家框架,自动发现未知类别的细粒度图像分类新方法

Generalized Fine-Grained Category Discovery with Multi-Granularity Conceptual Experts

  • 通过动态概念对比学习挖掘多粒度视觉概念,联合优化特征与类别发现
  • 在9个基准上实现当前最佳性能,新类别识别准确率提升3.6%以上
  • 无需预先知道类别数量,适合真实开放世界场景,适合图像聚类研究者

广义类别发现(GCD)是一个开放世界问题,旨在利用部分标注类别知识对未标注数据进行聚类。核心挑战在于未标注数据可能包含已知和新类别。现有方法存在两大局限:一是未能充分挖掘视觉数据中的多粒度概念信息,影响表征质量;二是大多假设训练时已知未标注类别数量,这在现实场景中不切实际。为此,我们提出多粒度概念专家(MGCE)框架,自适应挖掘视觉概念并融合多粒度知识以实现精准类别发现。MGCE包含两个模块:(1) 动态概念对比学习(DCCL),交替进行概念挖掘与双层表征学习,联合优化特征学习与类别发现;(2) 多粒度专家协同学习(MECL),通过引入不同粒度的额外专家,并使用概念对齐矩阵实现跨专家有效协作。重要的是,MGCE可自动估计未标注数据中的类别数量,适用于实际开放世界设置。在九个细粒度视觉识别基准上的大量实验表明,MGCE达到当前最优结果,尤其在新类别准确率上表现突出。值得注意的是,即使没有类别数量先验,其性能仍优于需已知类别数的参数化方法,平均提升3.6%。代码已开源。

原文摘要 · Abstract (English)

Generalized Category Discovery (GCD) is an open-world problem that clusters unlabeled data by leveraging knowledge from partially labeled categories. A key challenge is that unlabeled data may contain both known and novel categories. Existing approaches suffer from two main limitations. First, they fail to exploit multi-granularity conceptual information in visual data, which limits representation quality. Second, most assume that the number of unlabeled categories is known during training, which is impractical in real-world scenarios. To address these issues, we propose a Multi-Granularity Conceptual Experts (MGCE) framework that adaptively mines visual concepts and integrates multi-granularity knowledge for accurate category discovery. MGCE consists of two modules: (1) Dynamic Conceptual Contrastive Learning (DCCL), which alternates between concept mining and dual-level representation learning to jointly optimize feature learning and category discovery; and (2) Multi-Granularity Experts Collaborative Learning (MECL), which extends the single-expert paradigm by introducing additional experts at different granularities and by employing a concept alignment matrix for effective cross-expert collaboration. Importantly, MGCE can automatically estimate the number of categories in unlabeled data, making it suitable for practical open-world settings. Extensive experiments on nine fine-grained visual recognition benchmarks demonstrate that MGCE achieves state-of-the-art results, particularly in novel-class accuracy. Notably, even without prior knowledge of category numbers, MGCE outperforms parametric approaches that require knowing the exact number of categories, with an average improvement of 3.6\%. Code is available at https://github.com/HaiyangZheng/MGCE.

类别发现细粒度识别多粒度开放世界

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。