通过动态选锚与平滑惩罚,提升未知类别发现的伪标签质量。
Sharpness-aware Dynamic Anchor Selection for Generalized Category Discovery
- 引入损失尖锐度惩罚,抑制模型对无关特征的过拟合。
- 基于密度与概率动态选择未知类代表样本,提升聚类精度。
- 适合开放世界学习中需要高鲁棒性伪标签的场景。
广义类别发现(GCD)是开放世界学习中的关键挑战任务。给定已知类别的标注数据,目标是从包含已知和未知类别的无标签数据中进行聚类。现有基于参数化分类的方法采用类似DINO的伪标签策略,利用一个视角的软预测作为另一视角的监督信号。然而,大型预训练模型对特定视觉模式存在偏好,导致在无标签数据中编码虚假相关性,产生噪声伪标签。为此,本文提出新方法,包含两个模块:损失尖锐度惩罚(LSP)和动态锚点选择(DAS)。LSP通过最小化模型最坏情况下的损失尖锐度,增强参数对小扰动的鲁棒性,抑制平凡特征编码,减少噪声样本过拟合,从而提升伪标签质量。同时,DAS在训练过程中基于KNN密度和类别概率选择未知类的代表性样本,并为其分配硬伪标签,缓解已知与未知类间的置信度差异,加速模型学习更准确的未知类特征分布,进一步提升聚类性能。大量实验表明,该方法能有效降低伪标签噪声,在多个GCD基准上达到当前最优效果。
原文摘要 · Abstract (English)
Generalized category discovery (GCD) is an important and challenging task in open-world learning. Specifically, given some labeled data of known classes, GCD aims to cluster unlabeled data that contain both known and unknown classes. Current GCD methods based on parametric classification adopt the DINO-like pseudo-labeling strategy, where the sharpened probability output of one view is used as supervision information for the other view. However, large pre-trained models have a preference for some specific visual patterns, resulting in encoding spurious correlation for unlabeled data and generating noisy pseudo-labels. To address this issue, we propose a novel method, which contains two modules: Loss Sharpness Penalty (LSP) and Dynamic Anchor Selection (DAS). LSP enhances the robustness of model parameters to small perturbations by minimizing the worst-case loss sharpness of the model, which suppressing the encoding of trivial features, thereby reducing overfitting of noise samples and improving the quality of pseudo-labels. Meanwhile, DAS selects representative samples for the unknown classes based on KNN density and class probability during the model training and assigns hard pseudo-labels to them, which not only alleviates the confidence difference between known and unknown classes but also enables the model to quickly learn more accurate feature distribution for the unknown classes, thus further improving the clustering accuracy. Extensive experiments demonstrate that the proposed method can effectively mitigate the noise of pseudo-labels, and achieve state-of-the-art results on multiple GCD benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。