用极端值理论与代理锚点分离新类别,防止遗忘且减少误判。
Proxy-Anchor and EVT-Driven Continual Learning Method for Generalized Category Discovery
- 结合极端值理论与代理锚点,构建概率边界拒收未知样本。
- 提出新型损失函数,显著提升特征表示性能,优于现有方法。
- 通过缩减模型规模和重放机制,有效避免类别过估计与遗忘。
持续广义类别发现旨在连续学习新数据批次中的新类别,同时避免对已学类别的灾难性遗忘。本文提出一种新方法,将极端值理论(EVT)与代理锚点结合,利用包含概率函数在代理周围定义边界,实现未知样本的拒绝。此外,设计了一种基于EVT的新损失函数,增强特征表示能力,在类似设置下表现优于其他深度度量学习方法。基于推导的概率函数,能有效区分新旧类别。然而,新样本中类别发现可能高估新类别数量。为此,提出一种新的EVT方法以缩小模型规模并剔除冗余代理。在持续学习阶段还引入经验回放与知识蒸馏机制,防止灾难性遗忘。实验表明,该方法在持续广义类别发现场景中超越现有最优方法。
原文摘要 · Abstract (English)
Continual generalized category discovery has been introduced and studied in the literature as a method that aims to continuously discover and learn novel categories in incoming data batches while avoiding catastrophic forgetting of previously learned categories. A key component in addressing this challenge is the model's ability to separate novel samples, where Extreme Value Theory (EVT) has been effectively employed. In this work, we propose a novel method that integrates EVT with proxy anchors to define boundaries around proxies using a probability of inclusion function, enabling the rejection of unknown samples. Additionally, we introduce a novel EVT-based loss function to enhance the learned representation, achieving superior performance compared to other deep-metric learning methods in similar settings. Using the derived probability functions, novel samples are effectively separated from previously known categories. However, category discovery within these novel samples can sometimes overestimate the number of new categories. To mitigate this issue, we propose a novel EVT-based approach to reduce the model size and discard redundant proxies. We also incorporate experience replay and knowledge distillation mechanisms during the continual learning stage to prevent catastrophic forgetting. Experimental results demonstrate that our proposed approach outperforms state-of-the-art methods in continual generalized category discovery scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。