arXiv:2503.04451cs.LGcs.AI2025-03

提出无需样本数的隐私聚合方法,提升非独立同分布场景下的模型鲁棒性。

Privacy Preserving and Robust Aggregation for Cross-Silo Federated Learning in Non-IID Settings

  • 基于类别感知梯度掩码,仅依赖梯度更新,不传样本数等敏感信息。
  • 在非独立同分布数据下准确率提升5.2%,对抗后门攻击时模型保持完整。
  • 适合高隐私要求的跨域联邦学习,如医疗、金融等监管严格领域。

联邦平均(FedAvg)因简单高效被广泛使用,但在非独立同分布(non-IID)数据场景下性能显著下降,且依赖客户端上传训练样本数量等元数据,存在隐私泄露风险,与欧盟GDPR等法规冲突。本文提出一种新型聚合策略,通过引入类别感知梯度掩码,仅利用梯度更新完成聚合,无需任何额外元数据,增强隐私保护。该方法根据类别重要性动态评估并加权客户端贡献,有效应对非独立同分布分布、收敛偏差及后门攻击问题。在多个基准数据集上的实验表明,该方法在非独立同分布设置下优于FedAvg及其他主流聚合策略,且在对抗性攻击下仍能保持模型完整性。结果验证了梯度掩码在实际联邦学习中的可行性和安全性。

原文摘要 · Abstract (English)

Federated Averaging remains the most widely used aggregation strategy in federated learning due to its simplicity and scalability. However, its performance degrades significantly in non-IID data settings, where client distributions are highly imbalanced or skewed. Additionally, it relies on clients transmitting metadata, specifically the number of training samples, which introduces privacy risks and may conflict with regulatory frameworks like the European GDPR. In this paper, we propose a novel aggregation strategy that addresses these challenges by introducing class-aware gradient masking. Unlike traditional approaches, our method relies solely on gradient updates, eliminating the need for any additional client metadata, thereby enhancing privacy protection. Furthermore, our approach validates and dynamically weights client contributions based on class-specific importance, ensuring robustness against non-IID distributions, convergence prevention, and backdoor attacks. Extensive experiments on benchmark datasets demonstrate that our method not only outperforms FedAvg and other widely accepted aggregation strategies in non-IID settings but also preserves model integrity in adversarial scenarios. Our results establish the effectiveness of gradient masking as a practical and secure solution for federated learning.

联邦学习隐私保护非独立同分布梯度掩码

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。