arXiv:2603.11501cs.LGcs.AI2026-03中稿 · the ACM Web Confer…被引 1

针对图谱增强生成的新型投毒攻击,可绕过防御机制精准操控模型输出。

KEPo: Knowledge Evolution Poison on Graph-based Retrieval-Augmented Generation

  • 通过构造演化路径将毒化知识融入图谱,使模型误信恶意信息。
  • 在多目标场景下实现攻击知识互强化,成功率显著超越现有方法。
  • 揭示图谱增强生成系统的潜在安全漏洞,适合安全研究者关注。

基于图谱的检索增强生成(GraphRAG)通过外部数据库构建知识图谱(KG),以提升大语言模型(LLM)生成内容的时效性与准确性。然而,其对外部数据的依赖引入了新的攻击面。攻击者可向数据库注入毒化文本,诱使LLM对特定查询生成有害响应。现有研究主要针对传统RAG系统,但对GraphRAG无效。这是由于GraphRAG的图谱抽象机制会重构注入文本,在检索前将其组织为图结构,使模型基于重构上下文推理,而非原始毒化段落。为暴露GraphRAG的潜在安全漏洞,我们提出知识演化投毒(KEPo),一种专为GraphRAG设计的新攻击方法。针对每个目标查询,KEPo首先根据目标答案生成含毒事件。通过虚构事件背景并伪造从原始事实到毒化事件的知识演化路径,将其注入图谱,诱导模型将毒化知识视为最终结果。在多目标攻击场景中,KEPo进一步连接多个攻击语料库,使毒化知识相互强化并扩大污染社区规模,从而放大攻击效果。多数据集实验表明,KEPo在单目标和多目标攻击中均达到当前最优攻击成功率,显著优于以往方法。

原文摘要 · Abstract (English)

Graph-based Retrieval-Augmented Generation (GraphRAG) constructs the Knowledge Graph (KG) from external databases to enhance the timeliness and accuracy of Large Language Model (LLM) generations. However, this reliance on external data introduces new attack surfaces. Attackers can inject poisoned texts into databases to manipulate LLMs into producing harmful target responses for attacker-chosen queries. Existing research primarily focuses on attacking conventional RAG systems. However, such methods are ineffective against GraphRAG. This robustness derives from the KG abstraction of GraphRAG, which reorganizes injected text into a graph before retrieval, thereby enabling the LLM to reason based on the restructured context instead of raw poisoned passages. To expose latent security vulnerabilities in GraphRAG, we propose Knowledge Evolution Poison (KEPo), a novel poisoning attack method specifically designed for GraphRAG. For each target query, KEPo first generates a toxic event containing poisoned knowledge based on the target answer. By fabricating event backgrounds and forging knowledge evolution paths from original facts to the toxic event, it then poisons the KG and misleads the LLM into treating the poisoned knowledge as the final result. In multi-target attack scenarios, KEPo further connects multiple attack corpora, enabling their poisoned knowledge to mutually reinforce while expanding the scale of poisoned communities, thereby amplifying attack effectiveness. Experimental results across multiple datasets demonstrate that KEPo achieves state-of-the-art attack success rates for both single-target and multi-target attacks, significantly outperforming previous methods.

图谱生成安全攻击投毒攻击

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。