arXiv:2507.15280cs.LG2025-07

提出流式遗忘机制,实现高效无原始数据的持续数据删除。

Machine Unlearning for Streaming Forgetting

  • 将流式遗忘建模为分布漂移问题,无需原始训练数据。
  • 理论证明误差随轮次增长呈根号级,且不依赖凸损失函数。
  • 适用于持续请求删除数据的场景,如隐私保护与合规更新。

机器遗忘旨在移除模型中特定训练数据的知识。现有方法通常一次性批量处理遗忘请求,但在实际应用中,数据删除请求常以流式方式出现,导致效率与效果下降。本文针对流式遗忘带来的性能保持、效率及数据访问挑战,提出一种流式遗忘范式,将遗忘过程形式化为分布漂移问题。通过估计分布变化,提出一种无需原始训练数据即可实现高效流式遗忘的新算法。理论分析表明,该方法在温和条件下具有 $O(\ oot{2}{T} + V_T)$ 的遗忘遗憾上界,其中 $V_T$ 表示在 $T$ 次学习轮次中最优解的累积总变差。实验在多种模型与数据集上验证了方法的有效性。

原文摘要 · Abstract (English)

Machine unlearning aims to remove knowledge of the specific training data in a well-trained model. Currently, machine unlearning methods typically handle all forgetting data in a single batch, removing the corresponding knowledge all at once upon request. However, in practical scenarios, requests for data removal often arise in a streaming manner rather than in a single batch, leading to reduced efficiency and effectiveness in existing methods. Such challenges of streaming forgetting have not been the focus of much research. In this paper, to address the challenges of performance maintenance, efficiency, and data access brought about by streaming unlearning requests, we introduce a streaming unlearning paradigm, formalizing the unlearning as a distribution shift problem. We then estimate the altered distribution and propose a novel streaming unlearning algorithm to achieve efficient streaming forgetting without requiring access to the original training data. Theoretical analyses confirm an $O(\sqrt{T} + V_T)$ error bound on the streaming unlearning regret, where $V_T$ represents the cumulative total variation in the optimal solution over $T$ learning rounds. This theoretical guarantee is achieved under mild conditions without the strong restriction of convex loss function. Experiments across various models and datasets validate the performance of our proposed method.

机器遗忘流式学习隐私保护无数据遗忘

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。