提出隐私保护方案KD-UFSL,防止联邦分割学习中中间数据泄露。
Guarding the Middle: Protecting Intermediate Representations in Federated Split Learning
- 用微聚类和差分隐私保护客户端上传的中间表示
- 使重建图像均方误差最高提升50%,结构相似性降低40%
- 兼顾隐私与模型性能,适合大规模数据场景
在数据分布广泛且量大的场景下,联邦学习(FL)可实现去中心化训练而不集中数据。然而,去中心化带来客户端计算负担。U型联邦分割学习(UFSL)将部分计算移至服务器,同时保持数据和标签在客户端。但客户端向服务器传输的中间表示(即“挤压数据”)易暴露私有信息。本文揭示攻击者可通过数据重构攻击从中间表示中恢复客户端私密数据,并提出基于k-匿名差分隐私的UFSL(KD-UFSL)方案,结合微聚类与差分隐私技术,降低数据泄露风险。实验表明,该方法在四个基准数据集上使真实图像与重构图像间的均方误差最高提升50%,结构相似性降低40%;更重要的是,在增强隐私的同时保持了全局模型的实用性,适用于需平衡隐私与性能的大规模应用。
原文摘要 · Abstract (English)
Big data scenarios, where massive, heterogeneous datasets are distributed across clients, demand scalable, privacy-preserving learning methods. Federated learning (FL) enables decentralized training of machine learning (ML) models across clients without data centralization. Decentralized training, however, introduces a computational burden on client devices. U-shaped federated split learning (UFSL) offloads a fraction of the client computation to the server while keeping both data and labels on the clients' side. However, the intermediate representations (i.e., smashed data) shared by clients with the server are prone to exposing clients' private data. To reduce exposure of client data through intermediate data representations, this work proposes k-anonymous differentially private UFSL (KD-UFSL), which leverages privacy-enhancing techniques such as microaggregation and differential privacy to minimize data leakage from the smashed data transferred to the server. We first demonstrate that an adversary can access private client data from intermediate representations via a data-reconstruction attack, and then present a privacy-enhancing solution, KD-UFSL, to mitigate this risk. Our experiments indicate that, alongside increasing the mean squared error between the actual and reconstructed images by up to 50% in some cases, KD-UFSL also decreases the structural similarity between them by up to 40% on four benchmarking datasets. More importantly, KD-UFSL improves privacy while preserving the utility of the global model. This highlights its suitability for large-scale big data applications where privacy and utility must be balanced.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。