arXiv:2601.07214cs.CRcs.AI2026-01TPAMI被引 2

用户无需上传原始数据即可安全删除模型中个人数据,保护隐私。

BlindU: Blind Machine Unlearning without Revealing Erasing Data

  • 用压缩表示代替原始数据进行遗忘,避免数据泄露。
  • 结合信息瓶颈与梯度优化,实现高效且低效用损失的遗忘。
  • 适合联邦学习等严格限制数据外泄的隐私场景。

机器遗忘使数据持有者能移除其指定样本对训练模型的影响以保护隐私。然而,多数方法要求请求者先上传数据至服务器,这在禁止服务器访问用户数据的场景(如联邦学习)中不可行。本文提出盲遗忘(BlindU),通过使用压缩表示而非原始输入实现遗忘。仅涉及服务器与遗忘用户:用户本地生成隐私保护表示,服务器仅基于这些表示及其标签执行遗忘。针对联邦学习训练,采用信息瓶颈(IB)机制,其编码器学习去除输入中与任务无关的信息,使用户可本地生成压缩表示。为有效利用压缩表示进行遗忘,BlindU引入两个专用于IB模型的遗忘模块,并采用多梯度下降算法平衡遗忘效果与模型性能保留。尽管IB压缩已能保护输入中的非任务相关信息,为进一步增强隐私,提出无噪声差分隐私(DP)掩码方法,在压缩前处理原始删除数据。理论分析与大量实验表明,相比现有最佳隐私保护遗忘基准,BlindU在隐私保护与遗忘有效性方面表现更优。

原文摘要 · Abstract (English)

Machine unlearning enables data holders to remove the contribution of their specified samples from trained models to protect their privacy. However, it is paradoxical that most unlearning methods require the unlearning requesters to firstly upload their data to the server as a prerequisite for unlearning. These methods are infeasible in many privacy-preserving scenarios where servers are prohibited from accessing users' data, such as federated learning (FL). In this paper, we explore how to implement unlearning under the condition of not uncovering the erasing data to the server. We propose \textbf{Blind Unlearning (BlindU)}, which carries out unlearning using compressed representations instead of original inputs. BlindU only involves the server and the unlearning user: the user locally generates privacy-preserving representations, and the server performs unlearning solely on these representations and their labels. For the FL model training, we employ the information bottleneck (IB) mechanism. The encoder of the IB-based FL model learns representations that distort maximum task-irrelevant information from inputs, allowing FL users to generate compressed representations locally. For effective unlearning using compressed representation, BlindU integrates two dedicated unlearning modules tailored explicitly for IB-based models and uses a multiple gradient descent algorithm to balance forgetting and utility retaining. While IB compression already provides protection for task-irrelevant information of inputs, to further enhance the privacy protection, we introduce a noise-free differential privacy (DP) masking method to deal with the raw erasing data before compressing. Theoretical analysis and extensive experimental results illustrate the superiority of BlindU in privacy protection and unlearning effectiveness compared with the best existing privacy-preserving unlearning benchmarks.

机器遗忘联邦学习隐私保护信息瓶颈

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。