arXiv:2411.11039cs.LGcs.DC2024-11被引 12

用加速优化法实现联邦学习中数据精准删除,速度快且省资源。

FedUHB: Accelerating Federated Unlearning via Polyak Heavy Ball Method

  • 采用Polyak重球方法实现快速精确重训练
  • 动态停止机制减少约40%迭代次数
  • 适合需要严格数据删除的隐私保护场景

联邦学习允许多方协作训练模型同时保护数据隐私。随着“被遗忘权”日益重要,亟需高效的数据移除机制。现有联邦去学习(FU)方法多依赖近似策略,在数据影响清除与计算开销间难以兼顾,常无法彻底消除数据痕迹。为此,本文提出FedUHB,一种基于Polyak重球优化技术的精确去学习方法,实现快速重训练。同时引入动态停止机制,优化去学习过程终止时机。大量实验表明,FedUHB不仅显著提升去学习效率,且在去学习后仍保持鲁棒的模型性能;动态停止机制有效降低约40%的迭代次数,节省计算与通信资源。该方法可证明为联邦学习中精确数据删除的有效高效方案。

原文摘要 · Abstract (English)

Federated learning facilitates collaborative machine learning, enabling multiple participants to collectively develop a shared model while preserving the privacy of individual data. The growing importance of the "right to be forgotten" calls for effective mechanisms to facilitate data removal upon request. In response, federated unlearning (FU) has been developed to efficiently eliminate the influence of specific data from the model. Current FU methods primarily rely on approximate unlearning strategies, which seek to balance data removal efficacy with computational and communication costs, but often fail to completely erase data influence. To address these limitations, we propose FedUHB, a novel exact unlearning approach that leverages the Polyak heavy ball optimization technique, a first-order method, to achieve rapid retraining. In addition, we introduce a dynamic stopping mechanism to optimize the termination of the unlearning process. Our extensive experiments show that FedUHB not only enhances unlearning efficiency but also preserves robust model performance after unlearning. Furthermore, the dynamic stopping mechanism effectively reduces the number of unlearning iterations, conserving both computational and communication resources. FedUHB can be proved as an effective and efficient solution for exact data removal in federated learning settings.

联邦学习去学习优化加速

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。