针对跨设备联邦学习,提出敏感度引导的加密选择方法,兼顾安全与效率。
SenseCrypt: Sensitivity-guided Selective Homomorphic Encryption for Joint Federated Learning in Cross-Device Scenarios
- 根据参数敏感度聚类客户端,识别数据分布相似者
- 动态计算每组可加密参数比例,避免训练延迟
- 在保证抗攻击安全的同时,提速超58%,适合资源不均场景
同态加密(HE)广泛用于保护联邦学习(FL)隐私,但存在高开销和适应成本问题。部分加密方法通过全局掩码仅加密部分模型参数,期望在降低开销的同时保持易适配性。然而,在数据和系统能力异构的跨设备场景下,传统方法加剧了客户端延迟问题,且难以有效减少HE开销。为此,本文提出SenseCrypt:一种基于敏感度引导的可选同态加密框架,以自适应平衡各客户端的安全性与加密开销。我们发现模型参数敏感度能有效衡量客户端间数据分布相似性,据此设计了一种隐私保护聚类方法,将具有相似数据分布的客户端分组。接着,提出评分机制,推断每组中可加密参数的无延迟比例。最后,为每个客户端构建并求解多目标优化问题,最小化加密开销,最大化安全性,同时避免引入延迟。实验表明,SenseCrypt可抵御当前最先进的反演攻击,保持与独立同分布(IID)数据相当的模型精度,相比传统HE方法,训练时间减少58.4%至88.7%。
原文摘要 · Abstract (English)
Homomorphic Encryption (HE) prevails in securing Federated Learning (FL), but suffers from high overhead and adaptation cost. Selective HE methods, which partially encrypt model parameters by a global mask, are expected to protect privacy with reduced overhead and easy adaptation. However, in cross-device scenarios with heterogeneous data and system capabilities, traditional Selective HE methods deteriorate client straggling, and suffer from degraded HE overhead reduction performance. Accordingly, we propose SenseCrypt, a Sensitivity-guided selective Homomorphic EnCryption framework, to adaptively balance security and HE overhead per cross-device FL client. Given the observation that model parameter sensitivity is effective for measuring clients' data distribution similarity, we first design a privacy-preserving method to respectively cluster the clients with similar data distributions. Then, we develop a scoring mechanism to deduce the straggler-free ratio of model parameters that can be encrypted by each client per cluster. Finally, for each client, we formulate and solve a multi-objective model parameter selection optimization problem, which minimizes HE overhead while maximizing model security without causing straggling. Experiments demonstrate that SenseCrypt ensures security against the state-of-the-art inversion attacks, while achieving normal model accuracy as on IID data, and reducing training time by 58.4%-88.7% as compared to traditional HE methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。