arXiv:2412.05830cs.CRcs.AI2024-12

利用大模型合并多攻击者数据,提升图神经网络的链接窃取攻击能力。

Large Language Models Merging for Enhancing the Link Stealing Attack on Graph Neural Networks

  • 通过微调大模型生成攻击者专属模型,再融合多个模型参数。
  • 融合后模型在已知和未知数据集上均实现高效攻击,成功率显著提升。
  • 适用于研究隐私安全与对抗攻击的学者,尤其关注图数据防护者。

图神经网络(GNN)在处理图数据方面表现优异,但其面临链接窃取攻击的严重隐私威胁,攻击者可提取节点间敏感关系,导致学术不端或欺诈行为。以往研究多局限于单一数据集,未探索跨数据集攻击,更未考虑多攻击者知识融合。本文提出一种新型链接窃取攻击方法,结合跨数据集攻击与大语言模型(LLM)。每个攻击者在其特定数据集上微调LLM以生成定制化攻击模型,随后引入新颖的模型融合方法,有效整合各攻击者模型参数。融合后的模型具备更强泛化能力,不仅可在原数据集上成功攻击,还能对未见过的(域外)数据集实施有效攻击。我们在四个数据集上进行大量实验,验证了方法的有效性;此外,使用三种不同GNN和LLM架构的实验进一步说明了该方法的通用性。

原文摘要 · Abstract (English)

Graph Neural Networks (GNNs), specifically designed to process the graph data, have achieved remarkable success in various applications. Link stealing attacks on graph data pose a significant privacy threat, as attackers aim to extract sensitive relationships between nodes (entities), potentially leading to academic misconduct, fraudulent transactions, or other malicious activities. Previous studies have primarily focused on single datasets and did not explore cross-dataset attacks, let alone attacks that leverage the combined knowledge of multiple attackers. However, we find that an attacker can combine the data knowledge of multiple attackers to create a more effective attack model, which can be referred to cross-dataset attacks. Moreover, if knowledge can be extracted with the help of Large Language Models (LLMs), the attack capability will be more significant. In this paper, we propose a novel link stealing attack method that takes advantage of cross-dataset and Large Language Models (LLMs). The LLM is applied to process datasets with different data structures in cross-dataset attacks. Each attacker fine-tunes the LLM on their specific dataset to generate a tailored attack model. We then introduce a novel model merging method to integrate the parameters of these attacker-specific models effectively. The result is a merged attack model with superior generalization capabilities, enabling effective attacks not only on the attackers' datasets but also on previously unseen (out-of-domain) datasets. We conducted extensive experiments in four datasets to demonstrate the effectiveness of our method. Additional experiments with three different GNN and LLM architectures further illustrate the generality of our approach.

图神经网络隐私攻击大模型融合链接窃取

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。