arXiv:2409.07808cs.LG2024-09ECCV被引 1

用邻居混合生成代理原型,保护隐私的同时实现高效联邦学习。

FedHide: Federated Learning by Hiding in the Neighbors

  • 用最近邻线性组合生成隐藏真实原型的代理原型
  • 在CIFAR-100、VoxCeleb1、VGGFace2上达到良好分类性能
  • 可抵御梯度反演攻击,适合敏感数据场景

我们提出一种基于原型的联邦学习方法,适用于分类或验证任务中的嵌入网络。针对每个客户端仅拥有单一类别数据的场景,核心挑战在于构建能区分不同类别的嵌入网络,同时满足隐私约束。直接共享真实类别原型可能泄露敏感信息。为此,我们提出一种代理类别原型,在客户端间共享而非真实原型。该方法通过将原型与其最近邻线性组合生成代理原型,既隐藏了真实原型,又使客户端能学习具有判别性的嵌入网络。我们对比了添加高斯噪声和基于余弦相似性约束的随机选择等替代方案。此外,评估了方法对梯度反演攻击的鲁棒性,并引入原型泄漏度量,量化共享代理原型时暴露的私密信息程度。还提供了方法收敛性的理论分析。实验结果表明,从零开始的联邦学习方法在三个基准数据集——CIFAR-100、VoxCeleb1 和 VGGFace2 上均表现出有效性。

原文摘要 · Abstract (English)

We propose a prototype-based federated learning method designed for embedding networks in classification or verification tasks. Our focus is on scenarios where each client has data from a single class. The main challenge is to develop an embedding network that can distinguish between different classes while adhering to privacy constraints. Sharing true class prototypes with the server or other clients could potentially compromise sensitive information. To tackle this issue, we propose a proxy class prototype that will be shared among clients instead of the true class prototype. Our approach generates proxy class prototypes by linearly combining them with their nearest neighbors. This technique conceals the true class prototype while enabling clients to learn discriminative embedding networks. We compare our method to alternative techniques, such as adding random Gaussian noise and using random selection with cosine similarity constraints. Furthermore, we evaluate the robustness of our approach against gradient inversion attacks and introduce a measure for prototype leakage. This measure quantifies the extent of private information revealed when sharing the proposed proxy class prototype. Moreover, we provide a theoretical analysis of the convergence properties of our approach. Our proposed method for federated learning from scratch demonstrates its effectiveness through empirical results on three benchmark datasets: CIFAR-100, VoxCeleb1, and VGGFace2.

联邦学习隐私保护原型学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。