系统梳理类别发现的各类方法与挑战,为开放世界学习提供全景视角。
Category Discovery: An Open-World Perspective
- 按新类别发现与泛化类别发现划分研究框架,涵盖持续、偏斜、联邦等场景。
- 实证表明大模型主干、层次线索和课程训练显著提升性能。
- 适合关注开放世界学习、无监督聚类及跨场景分类的研究者参考。
类别发现(CD)是一项新兴的开放世界学习任务,旨在利用已知类别的标注数据,自动对包含未见类别的无标签数据进行分类。近年来该任务受到广泛关注,催生了大量从不同角度解决该问题的方法。本文综述了相关文献,提出以新类别发现(NCD)和泛化类别发现(GCD)为基础的分类体系,并涵盖持续类别发现、数据分布偏斜、联邦类别发现等实际应用场景。针对每种设置,系统分析了表示学习、标签分配与类别数估计三大核心组件。通过全面基准测试,提炼出关键洞察:大规模预训练主干网络、层次化与辅助线索、课程式训练均有益于性能提升;但标签分配设计、类别数估计以及复杂多对象场景下的扩展仍存挑战。最后,总结现有研究洞见并指明未来方向。完整文献库可访问 https://github.com/Visual-AI/Category-Discovery。
原文摘要 · Abstract (English)
Category discovery (CD) is an emerging open-world learning task, which aims at automatically categorizing unlabelled data containing instances from unseen classes, given some labelled data from seen classes. This task has attracted significant attention over the years and leads to a rich body of literature trying to address the problem from different perspectives. In this survey, we provide a comprehensive review of the literature, and offer detailed analysis and in-depth discussion on different methods. Firstly, we introduce a taxonomy for the literature by considering two base settings, namely novel category discovery (NCD) and generalized category discovery (GCD), and several derived settings that are designed to address the extra challenges in different real-world application scenarios, including continual category discovery, skewed data distribution, federated category discovery, etc. Secondly, for each setting, we offer a detailed analysis of the methods encompassing three fundamental components, representation learning, label assignment, and estimation of class number. Thirdly, we benchmark all the methods and distill key insights showing that large-scale pretrained backbones, hierarchical and auxiliary cues, and curriculum-style training are all beneficial for category discovery, while challenges remain in the design of label assignment, the estimation of class numbers, and scaling to complex multi-object scenarios. Finally, we discuss the key insights from the literature so far and point out promising future research directions. We compile a living survey of the category discovery literature at https://github.com/Visual-AI/Category-Discovery.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。