用合成数据和交替训练提升联邦学习的隐私与精度
Integrating Homomorphic Encryption and Synthetic Data in FL for Privacy and Learning Quality
- 交替使用真实数据和合成数据进行本地训练,分轮加密或明文传输参数
- 模型准确率提升13.4%,同选择性加密相比加密开销降低48%
- 适合注重隐私且资源受限的联邦学习场景
联邦学习(FL)可在不共享敏感客户端数据的情况下协同训练模型,是隐私关键应用的核心。然而,FL面临保障学习质量、实现强隐私保护并控制资源消耗的双重挑战,尤其在使用计算成本高的同态加密(HE)时。本文提出一种名为交替联邦学习(Alt-FL)的方案,通过将合成数据生成与HE结合,并采用交错策略增强隐私保护下的学习性能。具体而言,其过程在真实数据训练轮次(authentic rounds)与合成数据训练轮次(synthetic rounds)间交替进行,并分别在真实与合成轮次中传输加密与明文模型参数。该方法借助合成数据提升数据集质量,从而提高模型准确率;同时通过同态加密保护客户端数据隐私;并通过交错策略有效控制加密/解密开销。实验表明,该方法能抵御数据泄露攻击(如DLG攻击),在模型准确率上较选择性同态加密(Selective HE)提升13.4%,同时减少高达48%的同态加密相关开销。
原文摘要 · Abstract (English)
Federated learning (FL) enables collaborative training of machine learning models without sharing sensitive client data, making it a cornerstone for privacy-critical applications. However, FL faces the dual challenge of ensuring learning quality and robust privacy protection while keeping resource consumption low, particularly when using computationally expensive techniques such as homomorphic encryption (HE). In this work, we enhance an FL process that preserves privacy using HE by integrating it with synthetic data generation and an interleaving strategy. Specifically, our solution, named Alternating Federated Learning (Alt-FL), consists of alternating between local training with authentic data (authentic rounds) and local training with synthetic data (synthetic rounds) and transferring the encrypted and plaintext model parameters on authentic and synthetic rounds (resp.). Our approach improves learning quality (e.g., model accuracy) through datasets enhanced with synthetic data, preserves client data privacy via HE, and keeps manageable encryption and decryption costs through our interleaving strategy. We evaluate our solution against data leakage attacks, such as the DLG attack, demonstrating robust privacy protection. Also, Alt-FL provides 13.4% higher model accuracy and decreases HE-related costs by up to 48% with respect to Selective HE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。