arXiv:2606.01527cs.LGcs.CR2026-06

提出近最优机器遗忘方法,显著降低删除数据影响的成本。

Near-Optimal Pure Machine Unlearning for Smooth Strongly Convex Losses

  • 设计新型遗忘算法,基于模型维度与遗忘精度动态调整代价
  • 理论证明遗忘误差上限与下限仅差条件数因子,逼近最优
  • 当遗忘精度远超维度时,比重训练快指数级,适合高维数据

机器遗忘旨在满足法律和用户需求,如被遗忘权,以消除个体数据对训练模型的影响。先前研究虽已针对光滑强凸随机优化中的遗忘提出算法与误差界,但遗忘的基本统计代价仍不明确。本文通过证明近似ε-遗忘的泛化风险超额误差的上下界,几乎解决了这一问题;上下界仅差一个条件数因子,在单位球上的均值估计中两者完全匹配。最优遗忘速率由常规统计误差加上一个插值项构成:当ε/d增大时,该惩罚项从重训练速率降至指数级更小值。特别地,当ε≫d时,本算法在精度上较从零重训练及差分隐私基线实现指数级提升;而当ε≤d时,从零重训练为最优。

原文摘要 · Abstract (English)

Machine unlearning is motivated by legal and user-facing requirements to remove the influence of individuals' data from trained models, such as the right to be forgotten. Prior work has developed algorithms and error bounds for unlearning in smooth strongly convex stochastic optimization, but the fundamental statistical cost of unlearning has remained unclear. We nearly resolve this problem by proving upper and lower bounds on the excess population risk of approximate $\varepsilon$-unlearning; our bounds are tight up to a condition-number factor. For mean estimation over the unit ball, our upper and lower bounds match. The optimal rate is the usual statistical error plus an unlearning penalty that interpolates between the retraining-from-scratch rate and an exponentially smaller term as $\varepsilon/d$ grows, where $d$ is the dimension of the model. In particular, when $\varepsilon \gg d$, our $\varepsilon$-unlearning algorithm offers an exponential accuracy improvement over retraining the model from scratch and differentially private baselines. On the other hand, when $\varepsilon \le d$, retraining from scratch is optimal.

机器遗忘优化理论统计学习差分隐私

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。