首次揭示图增强大模型在对抗攻击下的脆弱性,提出有效防御方案。
Adversarial Attacks and Defenses on Graph-aware Large Language Models (LLMs)
- 针对图结构编码设计漏洞,利用节点模板注入恶意节点实施攻击。
- 发现两类模型均易受不可察觉的特征扰动攻击,且序列模板增加风险。
- 提出GALGUARD框架,融合语言模型与图神经网络实现端到端防御。
大型语言模型(LLMs)正越来越多地与图结构数据结合,用于节点分类等任务,传统上由图神经网络(GNNs)主导。尽管这种融合利用了丰富的关系信息以提升性能,但其在对抗攻击下的鲁棒性仍未知。本文首次系统研究图增强型LLMs的脆弱性,采用针对图模型的现有攻击方法,包括污染攻击(训练时)和逃避攻击(测试时),针对两种代表性模型LLAGA(Chen et al. 2024)和GRAPHPROMPTER(Liu et al. 2024)。此外,我们发现LLAGA存在新攻击面:攻击者可通过向节点序列模板中插入恶意占位节点严重降低其性能。系统分析表明:(1)LLAGA中的节点序列模板会增加模型脆弱性;(2)GRAPHPROMPTER使用的GNN编码器更具鲁棒性;(3)两类模型仍对不可察觉的特征扰动攻击敏感。最后,我们提出端到端防御框架GALGUARD,结合基于LLM的特征修正模块以缓解特征级扰动,并集成适配的GNN防御机制以抵御结构攻击。
原文摘要 · Abstract (English)
Large Language Models (LLMs) are increasingly integrated with graph-structured data for tasks like node classification, a domain traditionally dominated by Graph Neural Networks (GNNs). While this integration leverages rich relational information to improve task performance, their robustness against adversarial attacks remains unexplored. We take the first step to explore the vulnerabilities of graph-aware LLMs by leveraging existing adversarial attack methods tailored for graph-based models, including those for poisoning (training-time attacks) and evasion (test-time attacks), on two representative models, LLAGA (Chen et al. 2024) and GRAPHPROMPTER (Liu et al. 2024). Additionally, we discover a new attack surface for LLAGA where an attacker can inject malicious nodes as placeholders into the node sequence template to severely degrade its performance. Our systematic analysis reveals that certain design choices in graph encoding can enhance attack success, with specific findings that: (1) the node sequence template in LLAGA increases its vulnerability; (2) the GNN encoder used in GRAPHPROMPTER demonstrates greater robustness; and (3) both approaches remain susceptible to imperceptible feature perturbation attacks. Finally, we propose an end-to-end defense framework GALGUARD, that combines an LLM-based feature correction module to mitigate feature-level perturbations and adapted GNN defenses to protect against structural attacks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。