arXiv:2501.04453cs.LG2025-01中稿 · Frontiers of Compu…被引 3

提出梯度净化方法,精准剔除恶意梯度同时保留有益信息。

Gradient Purification: Defense Against Poisoning Attack in Decentralized Federated Learning

  • 通过记录历史梯度识别恶意邻居并一次性清除其影响
  • 在非独立同分布数据下仍保持高模型准确率
  • 适合需要抗数据投毒的分布式学习场景

去中心化联邦学习(DFL)易受数据投毒攻击,恶意客户端可向邻近客户端发送篡改梯度。现有防御方法或逐轮拒绝对可疑梯度,或排除所有恶意客户端后重启聚合,均忽视了恶意客户端贡献中可能存在的有益成分。本文提出新型梯度净化防御方法(GPD),旨在分别降低恶意梯度的危害并保留模型权重中的有益信息,从而提升整体模型精度。在GPD中,每个良性客户端设计一个记录变量,追踪来自某一邻居的历史聚合梯度,实现对恶意邻居的精准检测,并一次性消除所有已聚合的恶意梯度。清理后,良性客户端使用净化后的梯度优化模型权重,既保留恶意客户端之前的有益成分,又充分利用良性客户端的标准贡献。我们分析了GPD的收敛性及其高精度能力。大量实验表明,GPD在独立同分布(iid)与非独立同分布(non-iid)数据分布下均能有效抵御数据投毒攻击,且显著优于当前最优防御方法的模型精度。

原文摘要 · Abstract (English)

Decentralized federated learning (DFL) is inherently vulnerable to data poisoning attacks, as malicious clients can transmit manipulated gradients to neighboring clients. Existing defense methods either reject suspicious gradients per iteration or restart DFL aggregation after excluding all malicious clients. They all neglect the potential benefits that may exist within contributions from malicious clients. In this paper, we propose a novel gradient purification defense, termed GPD, to defend against data poisoning attacks in DFL. It aims to separately mitigate the harm in gradients and retain benefits embedded in model weights, thereby enhancing overall model accuracy. For each benign client in GPD, a recording variable is designed to track historically aggregated gradients from one of its neighbors. It allows benign clients to precisely detect malicious neighbors and mitigate all aggregated malicious gradients at once. Upon mitigation, benign clients optimize model weights using purified gradients. This optimization not only retains previously beneficial components from malicious clients but also exploits canonical contributions from benign clients. We analyze the convergence of GPD, as well as its ability to harvest high accuracy. Extensive experiments demonstrate that, GPD is capable of mitigating data poisoning attacks under both iid and non-iid data distributions. It also significantly outperforms state-of-the-art defense methods in terms of model accuracy.

联邦学习对抗攻击梯度净化去中心化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。