arXiv:2505.14044cs.LG2025-05被引 3

通过最大化类别令牌流形容量,提升开放世界场景下的聚类效果。

Generalized Category Discovery via Token Manifold Capacity Learning

  • 以奇异值核范数衡量流形容量,优化类别令牌表示多样性。
  • 在粗粒度和细粒度数据集上均提升聚类准确率与类别数估计能力。
  • 适合需要鲁棒开放世界学习的场景,如未知类别识别任务。

广义类别发现(GCD)对提升深度学习模型在开放世界中的鲁棒性至关重要,其目标是聚类包含已知与未知类别的无标签数据。传统GCD方法侧重最小化类内差异,常牺牲流形容量,限制类内表示的丰富性。本文提出最大令牌流形容量(MTMC)新方法,优先最大化类别令牌的流形容量,以保留数据的多样性和复杂性。MTMC采用奇异值的核范数作为流形容量度量,确保样本表示保持信息丰富且结构良好。该方法增强了聚类判别性,使模型能捕捉精细语义特征,避免聚类过程中的关键信息丢失。通过理论分析与大量实验验证,MTMC在粗粒度与细粒度数据集上均优于现有GCD方法,显著提升聚类准确率与类别数估计性能。引入MTMC后,表征更完整,类间可分性更强,且有效缓解维度崩溃问题,确立其在鲁棒开放世界学习中的核心地位。代码开源:github.com/lytang63/MTMC。

原文摘要 · Abstract (English)

Generalized category discovery (GCD) is essential for improving deep learning models' robustness in open-world scenarios by clustering unlabeled data containing both known and novel categories. Traditional GCD methods focus on minimizing intra-cluster variations, often sacrificing manifold capacity, which limits the richness of intra-class representations. In this paper, we propose a novel approach, Maximum Token Manifold Capacity (MTMC), that prioritizes maximizing the manifold capacity of class tokens to preserve the diversity and complexity of data. MTMC leverages the nuclear norm of singular values as a measure of manifold capacity, ensuring that the representation of samples remains informative and well-structured. This method enhances the discriminability of clusters, allowing the model to capture detailed semantic features and avoid the loss of critical information during clustering. Through theoretical analysis and extensive experiments on coarse- and fine-grained datasets, we demonstrate that MTMC outperforms existing GCD methods, improving both clustering accuracy and the estimation of category numbers. The integration of MTMC leads to more complete representations, better inter-class separability, and a reduction in dimensional collapse, establishing MTMC as a vital component for robust open-world learning. Code is in github.com/lytang63/MTMC.

类别发现流形学习开放世界

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。