arXiv:2504.16763cs.LGcs.AI2025-04

提出抗噪的核集重放方法,提升增量学习在噪声数据下的稳定性。

Noise-Tolerant Coreset-Based Class Incremental Continual Learning

  • 基于核集构造抗噪重放缓冲区,提升记忆样本代表性。
  • 在五大数据集上显著降低遗忘率,噪声下准确率提升12%以上。
  • 适合部署于真实场景中存在标签或实例噪声的持续学习任务。

计算机视觉应用常需在部署后适应新数据分布,这要求具备持续学习(CL)能力。持续学习者必须能灵活适应新任务,同时最小化对旧任务的遗忘。然而,持续学习易引入噪声干扰训练过程。本文聚焦类别增量学习(CIL)中的标签噪声和独立实例噪声,研究基于核集(Coresets)构建记忆池的重放方法对噪声的敏感性。在通用加性噪声模型下,推导出该方法对无关实例噪声的鲁棒性新界,揭示若干关键洞见。基于理论设计两种抗噪重放缓冲区构建算法,在五个多样化数据集上对比了现有基于记忆的持续学习方法与所提方法在标签噪声和独立实例噪声下的表现。结果表明,现有方法缺乏鲁棒性,而新方法在噪声环境下显著提升分类准确率并有效减少遗忘。

原文摘要 · Abstract (English)

Many applications of computer vision require the ability to adapt to novel data distributions after deployment. Adaptation requires algorithms capable of continual learning (CL). Continual learners must be plastic to adapt to novel tasks while minimizing forgetting of previous tasks.However, CL opens up avenues for noise to enter the training pipeline and disrupt the CL. This work focuses on label noise and instance noise in the context of class-incremental learning (CIL), where new classes are added to a classifier over time, and there is no access to external data from past classes. We aim to understand the sensitivity of CL methods that work by replaying items from a memory constructed using the idea of Coresets. We derive a new bound for the robustness of such a method to uncorrelated instance noise under a general additive noise threat model, revealing several insights. Putting the theory into practice, we create two continual learning algorithms to construct noise-tolerant replay buffers. We empirically compare the effectiveness of prior memory-based continual learners and the proposed algorithms under label and uncorrelated instance noise on five diverse datasets. We show that existing memory-based CL are not robust whereas the proposed methods exhibit significant improvements in maximizing classification accuracy and minimizing forgetting in the noisy CIL setting.

持续学习核集抗噪增量学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。