针对联邦学习梯度泄露,提出轻量级混合防御方法。
SelectiveShield: Lightweight Hybrid Defense Against Gradient Leakage in Federated Learning
- 根据参数敏感性选择性加密关键参数,保留个性化信息。
- 在非独立同分布数据下仍保持模型性能,攻击成功率降低80%以上。
- 适合资源受限设备部署,兼顾隐私与效率。
联邦学习(FL)允许在分布式数据上协同训练模型,但易受梯度泄露攻击,导致用户敏感信息被重构。现有防御机制如差分隐私(DP)和同态加密(HE)常在隐私、模型效用与系统开销间权衡,尤其在非独立同分布(non-IID)数据和异构客户端环境下问题更突出。为此,我们提出SelectiveShield,一种轻量级混合防御框架,通过自适应融合选择性同态加密与差分隐私。该方法利用Fisher信息量化参数敏感性,使客户端本地识别关键参数。通过协作协商协议,客户端共同确定需用同态加密保护的最敏感参数集;对个体特有的重要参数则保留在本地以支持个性化,非关键参数则采用自适应差分隐私加噪。大量实验表明,SelectiveShield在显著降低梯度泄露风险的同时,维持了良好模型性能,为实际联邦学习部署提供了可扩展、实用的防御方案。
原文摘要 · Abstract (English)
Federated Learning (FL) enables collaborative model training on decentralized data but remains vulnerable to gradient leakage attacks that can reconstruct sensitive user information. Existing defense mechanisms, such as differential privacy (DP) and homomorphic encryption (HE), often introduce a trade-off between privacy, model utility, and system overhead, a challenge that is exacerbated in heterogeneous environments with non-IID data and varying client capabilities. To address these limitations, we propose SelectiveShield, a lightweight hybrid defense framework that adaptively integrates selective homomorphic encryption and differential privacy. SelectiveShield leverages Fisher information to quantify parameter sensitivity, allowing clients to identify critical parameters locally. Through a collaborative negotiation protocol, clients agree on a shared set of the most sensitive parameters for protection via homomorphic encryption. Parameters that are uniquely important to individual clients are retained locally, fostering personalization, while non-critical parameters are protected with adaptive differential privacy noise. Extensive experiments demonstrate that SelectiveShield maintains strong model utility while significantly mitigating gradient leakage risks, offering a practical and scalable defense mechanism for real-world federated learning deployments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。