解决未知类别发现中的标签偏差问题,提升分类准确性。
DebGCD: Debiased Learning with Distribution Guidance for Generalized Category Discovery
- 通过双分支结构同时训练去偏分类器与分布检测器。
- 在多个基准上达到最先进性能,显著降低未知类误判率。
- 适合需要鲁棒类别发现的开放世界视觉任务研究者。
本文针对广义类别发现(GCD)问题,提出一种基于分布引导的去偏学习框架DebGCD。给定包含标注与未标注图像的数据集,目标是将所有未标注样本正确归类,无论其属于已知或未知类别。现有方法因缺乏未知类真实标签而存在固有标签偏差,且对未标注样本一视同仁,忽视其置信度差异,导致学习效果不佳。此外,已知与未知类间语义分布变化的关键信息常被忽略。为应对上述挑战,DebGCD在统一特征空间中协同训练一个辅助去偏分类器,逐步优化特征表示;另在独立特征空间引入语义分布检测器,隐式增强学习效果;并采用基于分布置信度的课程学习策略,调控去偏学习节奏。在多个GCD基准上的实验证明,该框架持续取得最优表现,展现出显著优势。
原文摘要 · Abstract (English)
In this paper, we tackle the problem of Generalized Category Discovery (GCD). Given a dataset containing both labelled and unlabelled images, the objective is to categorize all images in the unlabelled subset, irrespective of whether they are from known or unknown classes. In GCD, an inherent label bias exists between known and unknown classes due to the lack of ground-truth labels for the latter. State-of-the-art methods in GCD leverage parametric classifiers trained through self-distillation with soft labels, leaving the bias issue unattended. Besides, they treat all unlabelled samples uniformly, neglecting variations in certainty levels and resulting in suboptimal learning. Moreover, the explicit identification of semantic distribution shifts between known and unknown classes, a vital aspect for effective GCD, has been neglected. To address these challenges, we introduce DebGCD, a \underline{Deb}iased learning with distribution guidance framework for \underline{GCD}. Initially, DebGCD co-trains an auxiliary debiased classifier in the same feature space as the GCD classifier, progressively enhancing the GCD features. Moreover, we introduce a semantic distribution detector in a separate feature space to implicitly boost the learning efficacy of GCD. Additionally, we employ a curriculum learning strategy based on semantic distribution certainty to steer the debiased learning at an optimized pace. Thorough evaluations on GCD benchmarks demonstrate the consistent state-of-the-art performance of our framework, highlighting its superiority. Project page: https://visual-ai.github.io/debgcd/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。