仅加密分类头梯度仍可被攻破,导致隐私泄露
GDBR: Label Recovery Attack Against Partial Gradient Encryption in Federated Learning
- 通过构建梯度桥梁,从未加密层恢复标签
- 在多种模型和数据集上实现高精度标签推断
- 揭示部分加密策略的隐私漏洞,适合安全研究者
联邦学习(FL)通过共享梯度而非原始数据来保护隐私。目前一种常见做法是仅加密分类头梯度,以兼顾效率与安全。然而,本文提出GDBR攻击,首次证明即使仅共享一个未加密梯度层,也能实现高保真度的标签恢复。该攻击利用通用神经网络结构的漏洞,构建从非加密层到输出层的梯度桥,逼近最终输出的logits,从而精准推断私有标签。这些标签不仅暴露客户端数据敏感信息,还为数据重建、成员推理等下游攻击提供前提。理论分析与大量实验验证了该威胁在卷积与基于Transformer模型上的普遍性。研究挑战了“仅加密输出层即可保障隐私”的广泛假设。
原文摘要 · Abstract (English)
The increasing demand for data privacy, alongside the benefits of aggregating data from networked devices, has catalyzed the emergence of federated learning (FL). In FL, clients jointly train a global model by sharing gradients computed over private data. While this paradigm eliminates the need to exchange raw data, inference attacks can still be launched to extract sensitive information from gradients. To this end, partial gradient encryption has emerged as a promising design for balancing privacy and efficiency in practical FL systems, as encrypting only the classification-head gradients is believed to prevent known inference attacks while avoiding the high computational cost of encrypting the entire model. However, this design provides a false sense of privacy. By proposing GDBR, we show that sharing even a single unencrypted layer of gradients can lead to serious privacy leakage. GDBR is the first attack capable of high-fidelity label recovery with partial access to the gradients. It exploits a vulnerability in a commonly used neural building block, constructs a gradient bridge from the unencrypted layer to the final output layer, and approximates the logits information for accurate inference of private labels. These inferred labels not only reveal sensitive information about a client's private dataset but also serve as a prerequisite for many downstream attacks, such as data reconstruction and membership inference. GDBR brings these threats squarely into scope for FL systems employing partial encryption. In addition to theoretical analysis, extensive experiments demonstrate the severity of the problem across a wide variety of datasets and model architectures, including convolutional and transformer-based networks. Overall, our findings challenge the widespread assumption that encrypting only the output layer suffices for privacy protection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。