arXiv:2411.03663cs.LGcs.CR2024-11NeurIPS被引 3

提出高效方法评估图模型泄露训练数据敏感属性的风险。

Can Graph Neural Networks Expose Training Data Properties? An Efficient Risk Assessment Approach

  • 用模型近似技术生成大量影子模型,减少训练开销。
  • 攻击准确率提升2.7%,ROC-AUC提升4.1%,速度加快6.5倍。
  • 适合关注图神经网络隐私安全的研究者与实践者。

图神经网络(GNN)因广泛应用受到关注,但图数据稀缺与质量有限给实际训练带来挑战。为提升模型效果,研究者常通过外部合作共享模型而非原始数据。然而,这些模型可能仍泄露训练图的敏感属性(如交易网络中的平均违约率),造成严重风险。本文研究图属性推断攻击,评估模型泄露风险。现有方法需训练大量影子模型,计算成本高。为此,我们提出一种高效攻击方法:仅需在少量图上训练基础模型,再通过模型近似生成足够多的影子模型。为提升近似模型多样性并控制误差,引入编辑距离衡量组内差异,并设计理论保证的误差评估准则。进一步提出新型选择机制,确保保留的模型兼具高多样性与低误差。在六个真实场景下的实验表明,本方法攻击准确率平均提升2.7%,ROC-AUC提升4.1%,同时比最优基线快6.5倍。

原文摘要 · Abstract (English)

Graph neural networks (GNNs) have attracted considerable attention due to their diverse applications. However, the scarcity and quality limitations of graph data present challenges to their training process in practical settings. To facilitate the development of effective GNNs, companies and researchers often seek external collaboration. Yet, directly sharing data raises privacy concerns, motivating data owners to train GNNs on their private graphs and share the trained models. Unfortunately, these models may still inadvertently disclose sensitive properties of their training graphs (e.g., average default rate in a transaction network), leading to severe consequences for data owners. In this work, we study graph property inference attack to identify the risk of sensitive property information leakage from shared models. Existing approaches typically train numerous shadow models for developing such attack, which is computationally intensive and impractical. To address this issue, we propose an efficient graph property inference attack by leveraging model approximation techniques. Our method only requires training a small set of models on graphs, while generating a sufficient number of approximated shadow models for attacks. To enhance diversity while reducing errors in the approximated models, we apply edit distance to quantify the diversity within a group of approximated models and introduce a theoretically guaranteed criterion to evaluate each model's error. Subsequently, we propose a novel selection mechanism to ensure that the retained approximated models achieve high diversity and low error. Extensive experiments across six real-world scenarios demonstrate our method's substantial improvement, with average increases of 2.7% in attack accuracy and 4.1% in ROC-AUC, while being 6.5$\times$ faster compared to the best baseline.

图神经网络隐私安全属性推断高效评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。