提出Adapter调优方法,提升新旧类别发现的平衡能力。
AdaptGCD: Multi-Expert Adapter Tuning for Generalized Category Discovery
- 用多专家适配器结构分离新旧类别数据
- 在7个数据集上显著提升发现性能
- 适合研究开放世界分类与自适应学习的读者
不同于传统半监督学习的闭世界假设,广义类别发现(GCD)假设无标签数据中包含未出现在有标签集合中的新类别,目标不仅是识别旧类别,还需发现新类别。现有研究通常通过微调策略(如部分微调、提示学习)将自监督预训练模型的知识迁移到GCD任务,但难以平衡预训练主干的泛化能力与任务适应性。为此,本文首次将适配器调优引入GCD任务,提出AdaptGCD方法,并揭示关键见解以启发未来研究。针对新旧类别监督信息差异,设计了带有路由约束的多专家适配器结构,使新旧类别数据被分配至不同专家组。在7个常用数据集上进行大量实验,性能显著提升,验证了方法有效性。
原文摘要 · Abstract (English)
Different from the traditional semi-supervised learning paradigm that is constrained by the close-world assumption, Generalized Category Discovery (GCD) presumes that the unlabeled dataset contains new categories not appearing in the labeled set, and aims to not only classify old categories but also discover new categories in the unlabeled data. Existing studies on GCD typically devote to transferring the general knowledge from the self-supervised pretrained model to the target GCD task via some fine-tuning strategies, such as partial tuning and prompt learning. Nevertheless, these fine-tuning methods fail to make a sound balance between the generalization capacity of pretrained backbone and the adaptability to the GCD task. To fill this gap, in this paper, we propose a novel adapter-tuning-based method named AdaptGCD, which is the first work to introduce the adapter tuning into the GCD task and provides some key insights expected to enlighten future research. Furthermore, considering the discrepancy of supervision information between the old and new classes, a multi-expert adapter structure equipped with a route assignment constraint is elaborately devised, such that the data from old and new classes are separated into different expert groups. Extensive experiments are conducted on 7 widely-used datasets. The remarkable improvements in performance highlight the effectiveness of our proposals.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。