用环面实现联邦学习中完全私密的参数聚合,兼顾隐私与精度。
Perfectly-Private Analog Secure Aggregation in Federated Learning
- 用环面替代有限域进行隐私保护聚合,确保数据分布均匀。
- 实验表明精度接近无隐私保护模型,优于传统有限域方法。
- 适合对隐私和模型性能都有高要求的联邦学习场景。
在联邦学习中,多方本地训练模型并共享参数,由中心服务器聚合更新全局模型。为防止敏感数据通过本地模型泄露,已有研究采用安全多方计算实现安全聚合。然而,完美隐私要求被聚合的掩码局部模型服从均匀分布,而实数上无法定义在掩码操作下不变的测度,必然导致信息泄露。将数据映射到有限域虽可规避此问题,但受限于定点模运算,存在精度与复杂度的固有权衡。本文提出一种基于环面的新安全参数聚合方法,利用环面上的均匀分布实现每个参与方数据的完美隐私,同时避免精度损失。实验表明,该协议在保持完美隐私的同时,性能接近无安全聚合的模型;相较于有限域方法,在某些情况下显著提升模型准确率与余弦相似度,是更优的安全选择。
原文摘要 · Abstract (English)
In federated learning, multiple parties train models locally and share their parameters with a central server, which aggregates them to update a global model. To address the risk of exposing sensitive data through local models, secure aggregation via secure multiparty computation has been proposed to enhance privacy. At the same time, perfect privacy can only be achieved by a uniform distribution of the masked local models to be aggregated. This raises a problem when working with real valued data, as there is no measure on the reals that is invariant under the masking operation, and hence information leakage is bound to occur. Shifting the data to a finite field circumvents this problem, but as a downside runs into an inherent accuracy complexity tradeoff issue due to fixed point modular arithmetic as opposed to floating point numbers that can simultaneously handle numbers of varying magnitudes. In this paper, a novel secure parameter aggregation method is proposed that employs the torus rather than a finite field. This approach guarantees perfect privacy for each party's data by utilizing the uniform distribution on the torus, while avoiding accuracy losses. Experimental results show that the new protocol performs similarly to the model without secure aggregation while maintaining perfect privacy. Compared to the finite field secure aggregation, the torus-based protocol can in some cases significantly outperform it in terms of model accuracy and cosine similarity, hence making it a safer choice.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。