利用多轮梯度演变实现高效联邦学习成员推理攻击
An Efficient Gradient-Based Inference Attack for Federated Learning
- 基于多轮最后层梯度的时序特征,构建影子模型学习训练模式
- 在CIFAR-100和Purchase100上实现高精度成员推理,开销与现有方法相当
- 适用于任意梯度模型,对聚合方威胁更敏感,高维数据泄露更强
联邦学习通过减少直接数据暴露提升隐私保护,但参与者与聚合方间交换模型更新仍可能泄露敏感信息。本文提出一种新型基于梯度的成员推理攻击,利用多轮联邦训练中最后一层梯度的时序演化特征。该方法采用影子技术学习训练记录的轮次级梯度模式,无需访问私有数据集,可应对半诚实与恶意对手(聚合方或数据持有者)。攻击还可自然扩展至离散属性推理,通过对比不同属性假设下的梯度响应。所提方法为模型无关,适用于任意基于梯度的模型,支持分类与回归任务。我们在CIFAR-100和Purchase100上评估成员推理,在乳腺癌威斯康星数据集上评估属性推理。结果表明攻击性能强劲,成员推理计算与内存开销与文献中另一攻击相当。研究揭示:多轮联邦学习会加剧推理攻击风险,聚合方比数据持有者构成更大威胁,且攻击效果受训练数据特性显著影响——维度更高、内容更丰富的数据导致更强的信息泄露。
原文摘要 · Abstract (English)
Federated Learning is a machine learning setting that reduces direct data exposure, improving the privacy guarantees of machine learning models. Yet, the exchange of model updates between the participants and the aggregator can still leak sensitive information. In this work, we present a new gradient-based membership inference attack for federated learning scenarios that exploits the temporal evolution of last-layer gradients across multiple federated rounds. Our method uses the shadow technique to learn round-wise gradient patterns of the training records, requiring no access to the private dataset, and is designed to consider both semi-honest and malicious adversaries (aggregators or data owners). Beyond membership inference, we also provide a natural extension of the proposed attack to discrete attribute inference by contrasting gradient responses under alternative attribute hypotheses. The proposed attacks are model-agnostic, and therefore applicable to any gradient-based model and can be applied to both classification and regression settings. We evaluate the attack on CIFAR-100 and Purchase100 datasets for membership inference and on Breast Cancer Wisconsin for attribute inference. Our findings reveal strong attack performance and comparable computational and memory overhead in membership inference when compared to another attack from the literature. The obtained results emphasize that multi-round federated learning can increase the vulnerability to inference attacks, that aggregators pose a more substantial threat than data owners, and that attack performance is strongly influenced by the nature of the training dataset, with richer, high-dimensional data leading to stronger leakage than simpler tabular data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。