arXiv:2502.20974cs.LGcs.AI2025-02KDD被引 5

解决少样本下持续学习中遗忘与开放识别难题。

Improving Open-world Continual Learning under the Constraints of Scarce Labeled Data

  • 用实例级令牌增强提升样本表征,缓解数据稀缺问题。
  • 构建基于间隔的开放边界,支持随时间演进的新任务检测。
  • 自适应知识空间实现未知到已知的动态更新,适合真实场景应用。

开放世界持续学习(OWCL)在顺序任务中适应新样本,增量式学习同时防止遗忘。然而现有方法仍需大量标注数据,难以在真实场景应用。由于新类别通常仅有少量标注样本,更现实的情况是少样本持续学习(OFCL)。本文研究了开放世界少样本持续学习(OFCL),面临三大挑战:(i) 在不遗忘旧知识的前提下学习无限任务并避免过拟合;(ii) 在标注数据有限时构建紧凑的决策边界以支持开放检测;(iii) 实现对已知与未知知识的迁移,并在获得新样本标签后将其从未知转为已知。为此,提出新型OFCL框架,包含三个核心组件:(1) 实例级令牌增强(ITA),通过引入额外知识丰富样本表示;(2) 基于间隔的开放边界(MOB),支持随时间涌现的新任务检测;(3) 自适应知识空间(AKS),赋予未知以知识,实现未知向已知的动态更新。大量实验表明,所提框架显著优于所有基线,具备实际意义与可复现性。代码已开源:https://github.com/liyj1201/OFCL。

原文摘要 · Abstract (English)

Open-world continual learning (OWCL) adapts to sequential tasks with open samples, learning knowledge incrementally while preventing forgetting. However, existing OWCL still requires a large amount of labeled data for training, which is often impractical in real-world applications. Given that new categories/entities typically come with limited annotations and are in small quantities, a more realistic situation is OWCL with scarce labeled data, i.e., few-shot training samples. Hence, this paper investigates the problem of open-world few-shot continual learning (OFCL), challenging in (i) learning unbounded tasks without forgetting previous knowledge and avoiding overfitting, (ii) constructing compact decision boundaries for open detection with limited labeled data, and (iii) transferring knowledge about knowns and unknowns and even update the unknowns to knowns once the labels of open samples are learned. In response, we propose a novel OFCL framework that integrates three key components: (1) an instance-wise token augmentation (ITA) that represents and enriches sample representations with additional knowledge, (2) a margin-based open boundary (MOB) that supports open detection with new tasks emerge over time, and (3) an adaptive knowledge space (AKS) that endows unknowns with knowledge for the updating from unknowns to knowns. Finally, extensive experiments show that the proposed OFCL framework outperforms all baselines remarkably with practical importance and reproducibility. The source code is released at https://github.com/liyj1201/OFCL.

持续学习少样本开放世界知识迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。