针对长尾分布下的持续学习,提出新型数据增强方法提升模型泛化能力。
PANDA -- Patch And Distribution-Aware Augmentation for Long-Tailed Exemplar-Free Continual Learning
- 基于CLIP识别关键区域,将稀有类特征迁移到常见类样本中。
- 通过自适应平衡策略缓解任务间分布差异,减少遗忘现象。
- 适用于冻结预训练模型的持续学习场景,尤其适合数据不平衡问题。
无示例持续学习(EFCL)限制存储过往任务数据,易受灾难性遗忘影响。尽管预训练模型(PTMs)被广泛用于EFCL,但现有方法常忽视真实数据分布的固有失衡。我们发现,现实数据流普遍存在双层失衡:数据集层面的分布不均,以及单个任务内的极端或反向偏斜,造成任务内与任务间的双重差异,阻碍有效学习与泛化。为此,我们提出PANDA——一种贴片与分布感知增强框架,可无缝集成至现有基于PTM的EFCL方法。PANDA利用CLIP编码器识别代表性区域,并将其移植到每个任务中常见类样本上,以增强低频类别;同时引入自适应平衡策略,借助先验任务分布平滑任务间不平衡,缩小各任务平均样本间的差距,实现冻结PTM下的更公平学习。大量实验与消融研究验证了PANDA在现有基于PTM的连续学习方法中的有效性,显著提升准确率并减轻灾难性遗忘。
原文摘要 · Abstract (English)
Exemplar-Free Continual Learning (EFCL) restricts the storage of previous task data and is highly susceptible to catastrophic forgetting. While pre-trained models (PTMs) are increasingly leveraged for EFCL, existing methods often overlook the inherent imbalance of real-world data distributions. We discovered that real-world data streams commonly exhibit dual-level imbalances, dataset-level distributions combined with extreme or reversed skews within individual tasks, creating both intra-task and inter-task disparities that hinder effective learning and generalization. To address these challenges, we propose PANDA, a Patch-and-Distribution-Aware Augmentation framework that integrates seamlessly with existing PTM-based EFCL methods. PANDA amplifies low-frequency classes by using a CLIP encoder to identify representative regions and transplanting those into frequent-class samples within each task. Furthermore, PANDA incorporates an adaptive balancing strategy that leverages prior task distributions to smooth inter-task imbalances, reducing the overall gap between average samples across tasks and enabling fairer learning with frozen PTMs. Extensive experiments and ablation studies demonstrate PANDA's capability to work with existing PTM-based CL methods, improving accuracy and reducing catastrophic forgetting.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。