arXiv:2503.01838cs.LGcs.DC2025-03ICLR被引 7

首次实现图数据梯度的精确逆向重构,揭示联邦学习中图结构隐私漏洞。

GRAIN: Exact Graph Reconstruction from Gradients

  • 利用GNN梯度的低秩特性,分步重建并拼接客户端子图
  • 在分子、引用和社交网络数据上实现最高80%图结构完全恢复
  • 针对GCN与GAT模型设计,适用于关注图数据隐私的研究者

联邦学习通过传输梯度更新而非原始数据来保护客户端隐私,但近期研究发现梯度反演攻击可从共享梯度中精确重构文本与图像数据。然而,其他常见数据类型如图结构数据的隐私风险仍不明确。为此,我们提出GRAIN,首个在诚实但好奇设置下对图数据实施精确梯度逆向攻击的方法,可同时恢复图结构与节点特征。我们聚焦于图卷积网络(GCN)和图注意力网络(GAT)——两类广泛用于图学习的框架。方法首先利用GNN梯度的低秩结构,高效重建并过滤客户端子图,再将其拼接以还原完整输入图。我们在分子、引用和社交网络数据集上使用新提出的评估指标进行测试,结果表明GRAIN能精确重建高达80%的图,显著优于基线方法(最多仅20%节点位置正确)。

原文摘要 · Abstract (English)

Federated learning claims to enable collaborative model training among multiple clients with data privacy by transmitting gradient updates instead of the actual client data. However, recent studies have shown the client privacy is still at risk due to the, so called, gradient inversion attacks which can precisely reconstruct clients' text and image data from the shared gradient updates. While these attacks demonstrate severe privacy risks for certain domains and architectures, the vulnerability of other commonly-used data types, such as graph-structured data, remain under-explored. To bridge this gap, we present GRAIN, the first exact gradient inversion attack on graph data in the honest-but-curious setting that recovers both the structure of the graph and the associated node features. Concretely, we focus on Graph Convolutional Networks (GCN) and Graph Attention Networks (GAT) -- two of the most widely used frameworks for learning on graphs. Our method first utilizes the low-rank structure of GNN gradients to efficiently reconstruct and filter the client subgraphs which are then joined to complete the input graph. We evaluate our approach on molecular, citation, and social network datasets using our novel metric. We show that GRAIN reconstructs up to 80% of all graphs exactly, significantly outperforming the baseline, which achieves up to 20% correctly positioned nodes.

图神经网络隐私攻击联邦学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。