arXiv:2605.22506cs.CRcs.LG2026-05

通过参考良性客户端生成伪梯度,提升联邦学习在动态攻击下的鲁棒性。

EnCAgg: Enhanced Clustering Aggregation for Robust Federated Learning against Dynamic Model Poisoning

论文配图:EnCAgg: Enhanced Clustering Aggregation for Robust Federated Learning against Dynamic Model Poisoning
图 1 · 摘自论文原文
  • 利用已知良性客户端作为参考,生成伪梯度连接稀疏良性异常点。
  • 在MNIST、CIFAR-10、MIND上对动态投毒攻击保持90%以上准确率。
  • 适合高异构数据、恶意客户端数量未知的联邦学习场景。

联邦学习面临模型投毒攻击的日益威胁,损害其隐私保护应用。现有防御方法通常依赖固定阈值或固定聚类数来区分恶意与良性梯度,难以适应恶意客户端的动态攻击策略,且因客户端本地数据异构性常导致良性梯度丢失。为此,本文提出一种新型鲁棒聚合方法:利用少量已知良性客户端作为参考,精准识别并过滤恶意梯度,同时尽可能保留良性梯度,即使恶意客户端数量未知且可变。首先,提出基于密度的低维梯度聚类方法,将梯度投影至最差异化的两个维度,通过密度聚类识别恶意梯度,保留聚类中的良性梯度及潜在良性异常点。其次,设计增强型低维梯度生成模型,学习生成与良性簇边界对齐的伪梯度,作为桥梁连接稀疏的良性异常点。最后,引入低维梯度重聚类,将生成的伪梯度与真实梯度共同聚类,恢复被误判为噪声点的良性梯度,使更多良性梯度参与聚合。在MNIST、CIFAR-10和MIND数据集上的大量实验表明,该方法在动态投毒场景下展现出卓越的保真度与鲁棒性。

原文摘要 · Abstract (English)

Federated learning faces increasing threats from model poisoning attacks, which harms its application to improve privacy. Existing defense methods typically rely on fixed thresholds or perform clustering with a fixed number of clusters to distinguish malicious gradients from benign ones. However, these methods are difficult to adapt to dynamic poisoning strategies of malicious clients, and often result in the loss of benign gradients due to the heterogeneity of clients' local datasets. To address these problems, we propose a novel robust aggregation method that leverages a small number of known benign clients as references, enabling accurate identification and filtering of malicious gradients while retaining as many benign gradients as possible, even when the number of malicious clients is unknown and variable. First, we introduce a density-based low-dimensional gradient clustering method, which projects gradients onto the two most divergent dimensions and applies density-based clustering to identify malicious gradients while retaining clustered benign gradients and potentially benign outliers. Second, we design an enhancing clustering low-dimensional gradient generator model, which learns to generate pseudo-gradients aligned with the boundary of the benign cluster. These pseudo-gradients act as bridges to connect sparse benign gradient outliers. Third, we introduce low-dimensional gradient re-clustering that clusters the generated pseudo-gradients together with real gradients to recover benign gradients misclassified as noise points, enabling more benign gradients to participate in aggregation. Extensive experiments on the MNIST, CIFAR-10, and MIND datasets demonstrate that our method exhibits superior fidelity and robustness under dynamic poisoning scenarios.

联邦学习对抗攻击聚类梯度防御

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。