提出新方法解决持续发现新类别时多样性与区分度的矛盾
Exploring the Tradeoff Between Diversity and Discrimination for Continuous Category Discovery
- 分离训练主干网络,用对比损失提升特征多样性
- 单阶段联合发现新类别,减少错误累积
- 用正交原型和代表性重放降低存储开销,适合长期学习
连续类别发现(CCD)旨在自动识别持续到达的无标签数据中的新类别。该任务极具挑战性:新数据中既无类别数量也无标签信息,还需避免灾难性遗忘。现有方法难以平衡新类别发现与分类性能,易在逐步发现过程中累积错误。多数方法依赖知识蒸馏和数据回放防止遗忘,占用大量存储空间。为此,本文提出基于独立性多样性与正交性区分度的IDOD方法。其包含独立多样性增强模块、联合新类发现模块和基于正交性的连续增量模块。独立多样性增强通过对比损失独立训练主干网络,避免过度关注分类特征;联合新类发现将多阶段发现转化为单阶段,降低误差传播;正交连续增量模块生成互正交原型用于分类,并通过代表性表示重放实现低存储开销的遗忘缓解。实验表明,在具有挑战性的细粒度数据集上,该方法优于当前最优方法。
原文摘要 · Abstract (English)
Continuous category discovery (CCD) aims to automatically discover novel categories in continuously arriving unlabeled data. This is a challenging problem considering that there is no number of categories and labels in the newly arrived data, while also needing to mitigate catastrophic forgetting. Most CCD methods cannot handle the contradiction between novel class discovery and classification well. They are also prone to accumulate errors in the process of gradually discovering novel classes. Moreover, most of them use knowledge distillation and data replay to prevent forgetting, occupying more storage space. To address these limitations, we propose Independence-based Diversity and Orthogonality-based Discrimination (IDOD). IDOD mainly includes independent enrichment of diversity module, joint discovery of novelty module, and continuous increment by orthogonality module. In independent enrichment, the backbone is trained separately using contrastive loss to avoid it focusing only on features for classification. Joint discovery transforms multi-stage novel class discovery into single-stage, reducing error accumulation impact. Continuous increment by orthogonality module generates mutually orthogonal prototypes for classification and prevents forgetting with lower space overhead via representative representation replay. Experimental results show that on challenging fine-grained datasets, our method outperforms the state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。