arXiv:2507.20573cs.LG2025-07ICCV被引 5

发现机器遗忘存在隐私漏洞,提出新攻击方法并设计有效防御方案。

Reminiscence Attack on Residuals: Exploiting Approximate Machine Unlearning for Privacy

  • 通过靶向微调放大残留信息,实现对删除数据的成员身份推断。
  • 新攻击在分类和样本级推断上准确率分别提升1.90倍和1.12倍。
  • 提出双阶段遗忘框架,仅需全重训练2%-12%计算量即可防御攻击。

机器遗忘使模型可移除特定数据以满足被遗忘权。尽管近似遗忘算法比完整重训更高效,但本文揭示其未能充分保护被遗忘数据的隐私:这些算法引入了隐式残留,使针对被遗忘数据的隐私攻击成为可能。我们观察到,无论模型结构、参数或遗忘算法如何,残留始终存在,构成传统输出泄露之外的新攻击面。基于此,提出回忆攻击(ReA),通过靶向微调增强残留与成员身份间的相关性。在类别级和样本级成员推断中,准确率分别达到先前攻击的1.90倍和1.12倍。为缓解此类残留风险,提出双阶段近似遗忘框架:先消除深层未学习数据痕迹,再通过收敛稳定性约束防止‘伪收敛’(即输出类似重训模型但仍保留残留)。该框架适用于分类与生成任务。实验验证其保持高遗忘效能的同时,将自适应隐私攻击准确率降至接近随机猜测,计算成本仅为从头重训的2%-12%。

原文摘要 · Abstract (English)

Machine unlearning enables the removal of specific data from ML models to uphold the right to be forgotten. While approximate unlearning algorithms offer efficient alternatives to full retraining, this work reveals that they fail to adequately protect the privacy of unlearned data. In particular, these algorithms introduce implicit residuals which facilitate privacy attacks targeting at unlearned data. We observe that these residuals persist regardless of model architectures, parameters, and unlearning algorithms, exposing a new attack surface beyond conventional output-based leakage. Based on this insight, we propose the Reminiscence Attack (ReA), which amplifies the correlation between residuals and membership privacy through targeted fine-tuning processes. ReA achieves up to 1.90x and 1.12x higher accuracy than prior attacks when inferring class-wise and sample-wise membership, respectively. To mitigate such residual-induced privacy risk, we develop a dual-phase approximate unlearning framework that first eliminates deep-layer unlearned data traces and then enforces convergence stability to prevent models from "pseudo-convergence", where their outputs are similar to retrained models but still preserve unlearned residuals. Our framework works for both classification and generation tasks. Experimental evaluations confirm that our approach maintains high unlearning efficacy, while reducing the adaptive privacy attack accuracy to nearly random guess, at the computational cost of 2-12% of full retraining from scratch.

机器遗忘隐私攻击深度学习安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。