arXiv:2507.02310cs.LGcs.AI2025-07被引 4

提出自适应记忆重对齐方法,高效应对真实数据流中的概念漂移。

Holistic Continual Learning under Concept Drift with Adaptive Memory Realignment

  • 通过选择性更新回放缓冲区中的旧样本,实现记忆与新分布的动态对齐。
  • 在多个视觉基准上达到全重训练效果,标签数据和计算量降低数量级。
  • 适合需要长期稳定又快速适应变化环境的持续学习场景。

传统持续学习方法侧重知识保留,隐含假设已学任务的数据分布保持静态,忽视了真实数据流中概念漂移导致的分布永久变化。本文提出一个面向概念漂移的全貌式持续学习框架,通过演化任务分布模拟真实场景。以全重训练(FR)为基线,虽有效但需大量标注与计算开销。为此,提出轻量级自适应记忆重对齐(AMR)方法,使基于回放的学习者具备漂移感知适应能力:主动从回放缓冲区中移除已过时的类别样本,并用少量最新实例补充,实现记忆与新分布的精准对齐。实验表明,AMR在多个标准视觉基准的四种概念漂移变体上,性能媲美FR,同时将标注需求与计算成本降低数量级。结果验证了AMR在非平稳环境中兼顾稳定性与可塑性的潜力。完整代码与数据集见:github.com/AlifAshrafee/CL-Under-Concept-Drift。

原文摘要 · Abstract (English)

Traditional continual learning methods prioritize knowledge retention and focus primarily on mitigating catastrophic forgetting, implicitly assuming that the data distribution of previously learned tasks remains static. This overlooks the dynamic nature of real-world data streams, where concept drift permanently alters previously seen data and demands both stability and rapid adaptation. We introduce a holistic framework for continual learning under concept drift that simulates realistic scenarios by evolving task distributions. As a baseline, we consider Full Relearning (FR), in which the model is retrained from scratch on newly labeled samples from the drifted distribution. While effective, this approach incurs substantial annotation and computational overhead. To address these limitations, we propose Adaptive Memory Realignment (AMR), a lightweight alternative that equips rehearsal-based learners with a drift-aware adaptation mechanism. AMR selectively removes outdated samples of drifted classes from the replay buffer and repopulates it with a small number of up-to-date instances, effectively realigning memory with the new distribution. This targeted resampling matches the performance of FR while reducing the need for labeled data and computation by orders of magnitude. To enable reproducible evaluation, we introduce four concept drift variants of standard vision benchmarks, where previously seen classes reappear with shifted representations. Comprehensive experiments on these datasets using several rehearsal-based baselines show that AMR consistently counters concept drift, maintaining high accuracy with minimal overhead. These results position AMR as a scalable solution that reconciles stability and plasticity in non-stationary continual learning environments. Full implementation of our framework and benchmark datasets is available at: github.com/AlifAshrafee/CL-Under-Concept-Drift.

持续学习概念漂移记忆重对齐视觉基准

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。