arXiv:2504.05822cs.LG2025-04被引 6

让联邦学习模型轻松删除用户数据,无需额外存储或数据集。

Federated Unlearning Made Practical: Seamless Integration via Negated Pseudo-Gradients

  • 用客户端更新反向梯度实现无痕遗忘
  • 在CIFAR和前列腺影像数据上效果领先
  • 适合需要合规删除的医疗与工业场景

被遗忘的权利是隐私保护法规的基本原则,也适用于联邦学习(FL)等机器学习范式。尽管FL通过不共享私有数据实现了协作训练,但训练后的模型仍会保留训练数据的影响。现有联邦遗忘(FU)方法常依赖不切实际的假设,如存储客户端更新历史或需访问公开数据集。为此,本文提出一种新方法——基于反向伪梯度的联邦遗忘(PUF)。该方法仅使用标准的客户端模型更新,并将其解释为伪梯度;当某客户端需被遗忘时,对全局模型施加其伪梯度的负值并适当缩放。相比现有技术,PUF可无缝集成至常规FL流程,不增加计算与通信开销,支持并发遗忘请求。我们在两个经典图像分类数据集(CIFAR-10、CIFAR-100)及一个真实世界医学影像分割数据集(ProstateMRI)上,采用三种神经网络架构(两种残差网络与一个视觉变换器)进行了广泛评估。实验结果表明,PUF在多种设置下均达到最优遗忘效果与恢复速度,且无需额外假设。

原文摘要 · Abstract (English)

The right to be forgotten is a fundamental principle of privacy-preserving regulations and extends to Machine Learning (ML) paradigms such as Federated Learning (FL). While FL enhances privacy by enabling collaborative model training without sharing private data, trained models still retain the influence of training data. Federated Unlearning (FU) methods recently proposed often rely on impractical assumptions for real-world FL deployments, such as storing client update histories or requiring access to a publicly available dataset. To address these constraints, this paper introduces a novel method that leverages negated Pseudo-gradients Updates for Federated Unlearning (PUF). Our approach only uses standard client model updates, which are employed during regular FL rounds, and interprets them as pseudo-gradients. When a client needs to be forgotten, we apply the negation of their pseudo-gradients, appropriately scaled, to the global model. Unlike state-of-the-art mechanisms, PUF seamlessly integrates with FL workflows, incurs no additional computational and communication overhead beyond standard FL rounds, and supports concurrent unlearning requests. We extensively evaluated the proposed method on two well-known benchmark image classification datasets (CIFAR-10 and CIFAR-100) and a real-world medical imaging dataset for segmentation (ProstateMRI), using three different neural architectures: two residual networks and a vision transformer. The experimental results across various settings demonstrate that PUF achieves state-of-the-art forgetting effectiveness and recovery time, without relying on any additional assumptions.

联邦学习数据遗忘隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。