用遗忘技术优化流数据中的模型更新,省去反复训练。
Unlearning-based sliding window for continual learning under concept drift
- 用机器遗忘移除旧数据影响,再增量更新新数据。
- 在多个概念漂移场景下,准确率优于传统滑动窗口方法。
- 适合需要快速适应变化数据的实时系统应用。
传统机器学习假设数据分布稳定,但许多实际应用面临非平稳数据流,其中基础概念随时间演化。这可视为无任务标识的持续学习中的概念漂移问题,模型需在无明确任务边界的情况下顺序适应。有效学习需快速适应新数据并遗忘过时信息。常用滑动窗口方法常因需重复从头训练而计算开销大。本文提出基于机器遗忘的新视角:当活动窗口变化时,不重建模型,而是通过遗忘机制消除旧样本影响,再用新数据更新模型。该方法实现高效、精准的遗忘,同时保持对演化分布的适应能力。据我们所知,这是首个将机器遗忘与概念漂移缓解结合用于无任务持续学习的工作。在多个漂移场景下的图像流分类实验表明,该方法在性能上具竞争力且计算更高效。代码可在 https://anonymous.4open.science/r/MUNDataStream-60F3 获得。
原文摘要 · Abstract (English)
Traditional machine learning assumes a stationary data distribution, yet many real-world applications operate on nonstationary streams in which the underlying concept evolves over time. This problem can also be viewed as task-free continual learning under concept drift, where a model must adapt sequentially without explicit task identities or task boundaries. In such settings, effective learning requires both rapid adaptation to new data and forgetting of outdated information. A common solution is based on a sliding window, but this approach is often computationally demanding because the model must be repeatedly retrained from scratch on the most recent data. We propose a different perspective based on machine unlearning. Instead of rebuilding the model each time the active window changes, we remove the influence of outdated samples using unlearning and then update the model with newly observed data. This enables efficient, targeted forgetting while preserving adaptation to evolving distributions. To the best of our knowledge, this is the first work to connect machine unlearning with concept drift mitigation for task-free continual learning. Empirical results on image stream classification across multiple drift scenarios demonstrate that the proposed approach offers a competitive and computationally efficient alternative to standard sliding-window retraining. Our implementation can be found at \hrehttps://anonymous.4open.science/r/MUNDataStream-60F3}{https://anonymous.4open.science/r/MUNDataStream-60F3}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。