利用模型偏差提升新类别发现能力,解决旧类别偏好与新类别混淆问题。
Unleashing the Potential of Model Bias for Generalized Category Discovery
- 通过有偏模型输出动态校准当前模型,缓解旧类别偏好。
- 在三个基准数据集上新类别识别准确率显著优于现有方法。
- 适合关注无监督新类别发现的算法研究者和工业落地场景。
广义类别发现旨在从无标签数据中识别已知与未知的新类别,依赖仅含已知类别的有标签数据集。主要挑战来自预训练引发的模型偏差及新类别缺乏精确监督,导致模型倾向已知类别且不同新类别间混淆,影响新类别识别效果。为此,本文提出自去偏校准(Self-Debiasing Calibration, SDC)框架。不同于以往将已知类别偏差视为障碍的做法,SDC创新性地利用该偏差促进新类别学习:有偏模型输出既用于建模偏差程度并实现去偏,又通过相似类别间知识迁移帮助区分不同新类别。SDC基于此动态调整当前模型的输出逻辑值,生成更少偏差的逻辑值和更精准的伪标签,有效缓解已知类别偏好与新类别混淆。在三个基准数据集上的实验表明,SDC在新类别识别上超越当前最优方法。代码与数据已开源。
原文摘要 · Abstract (English)
Generalized Category Discovery is a significant and complex task that aims to identify both known and undefined novel categories from a set of unlabeled data, leveraging another labeled dataset containing only known categories. The primary challenges stem from model bias induced by pre-training on only known categories and the lack of precise supervision for novel ones, leading to category bias towards known categories and category confusion among different novel categories, which hinders models' ability to identify novel categories effectively. To address these challenges, we propose a novel framework named Self-Debiasing Calibration (SDC). Unlike prior methods that regard model bias towards known categories as an obstacle to novel category identification, SDC provides a novel insight into unleashing the potential of the bias to facilitate novel category learning. Specifically, the output of the biased model serves two key purposes. First, it provides an accurate modeling of category bias, which can be utilized to measure the degree of bias and debias the output of the current training model. Second, it offers valuable insights for distinguishing different novel categories by transferring knowledge between similar categories. Based on these insights, SDC dynamically adjusts the output logits of the current training model using the output of the biased model. This approach produces less biased logits to effectively address the issue of category bias towards known categories, and generates more accurate pseudo labels for unlabeled data, thereby mitigating category confusion for novel categories. Experiments on three benchmark datasets show that SDC outperforms SOTA methods, especially in the identification of novel categories. Our code and data are available at \url{https://github.com/Lackel/SDC}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。