arXiv:2411.11044cs.CRcs.LG2024-11被引 26

提出高效且隐私安全的联邦遗忘方法,兼顾数据删除效率与隐私保护。

Efficient Federated Unlearning with Adaptive Differential Privacy Preservation

  • 采用自适应差分隐私机制,动态分配隐私预算提升安全性。
  • 通过双层筛选降低存储与通信开销,实现比重训快3倍以上。
  • 适合需合规删除数据的医疗、金融等高隐私要求场景。

联邦遗忘(Federated Unlearning, FU)为解决联邦学习中特定客户端数据影响的消除问题提供了有效方案,使个体获得“被遗忘的权利”。直接从头训练排除请求删除数据的客户端虽可行,但资源消耗大。现有先进方法利用历史更新记录实现更高效的遗忘,但存储的历史更新可能被攻击者用于重建本地数据,带来严重隐私风险。尽管已有隐私增强技术,但在兼顾遗忘效率与隐私保护的联邦遗忘场景中仍研究不足。为此,本文提出FedADP方法,在保证遗忘效率的同时实现隐私保护。该方法引入自适应差分隐私机制,通过专为联邦遗忘设计的预算分配策略平衡隐私与性能;采用双层选择机制,仅保留对全局模型变化显著且与全局模型一致的客户端更新,降低存储与通信开销;并设计一种新校准方法以支持有效遗忘。大量实验表明,FedADP能有效平衡遗忘效率与隐私保护,在多个数据集上实现比重训快3倍以上的加速,同时在10%的客户请求下保持较高隐私水平(ε < 2.5)。

原文摘要 · Abstract (English)

Federated unlearning (FU) offers a promising solution to effectively address the need to erase the impact of specific clients' data on the global model in federated learning (FL), thereby granting individuals the ``Right to be Forgotten". The most straightforward approach to achieve unlearning is to train the model from scratch, excluding clients who request data removal, but it is resource-intensive. Current state-of-the-art FU methods extend traditional FL frameworks by leveraging stored historical updates, enabling more efficient unlearning than training from scratch. However, the use of stored updates introduces significant privacy risks. Adversaries with access to these updates can potentially reconstruct clients' local data, a well-known vulnerability in the privacy domain. While privacy-enhanced techniques exist, their applications to FU scenarios that balance unlearning efficiency with privacy protection remain underexplored. To address this gap, we propose FedADP, a method designed to achieve both efficiency and privacy preservation in FU. Our approach incorporates an adaptive differential privacy (DP) mechanism, carefully balancing privacy and unlearning performance through a novel budget allocation strategy tailored for FU. FedADP also employs a dual-layered selection process, focusing on global models with significant changes and client updates closely aligned with the global model, reducing storage and communication costs. Additionally, a novel calibration method is introduced to facilitate effective unlearning. Extensive experimental results demonstrate that FedADP effectively manages the trade-off between unlearning efficiency and privacy protection.

联邦学习隐私保护数据删除

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。