arXiv:2507.08862cs.CRcs.CL2025-07被引 3

首次揭示知识图谱增强型生成系统的安全漏洞,提出隐蔽攻击方法。

RAG Safety: Exploring Knowledge Poisoning Attacks to Retrieval-Augmented Generation

  • 针对知识图谱构建攻击链,通过微小修改误导推理过程。
  • 在两个基准上使四种KG-RAG模型性能显著下降,扰动极小仍有效。
  • 适合关注AI安全、知识图谱应用的开发者与研究者阅读。

检索增强生成(RAG)通过引入外部数据缓解大语言模型的幻觉和过时知识问题。得益于对多源数据的强支持能力及忠实推理特性,知识图谱(KG)被越来越多地用于RAG系统,形成基于知识图谱的RAG(KG-RAG)方法。尽管RAG广泛应用,近期研究已揭示其易受数据投毒攻击:恶意信息注入外部知识源可导致系统生成错误或有害回答。然而,现有研究仅关注使用非结构化文本数据的RAG系统,未深入探讨具有结构性与可编辑性的知识图谱在KG-RAG中的安全风险。本文首次系统性研究了KG-RAG的安全问题,设计了一种贴近实际应用的隐蔽攻击场景。提出一种攻击策略:先确定目标答案,再插入扰动三元组,构建误导性推理链,提高KG-RAG在生成时检索并依赖这些扰动的概率。在两个基准和四种最新KG-RAG方法上进行大量实验,结果表明该攻击在极小知识图谱扰动下仍能显著降低系统性能。进一步分析揭示了KG-RAG内部阶段的安全威胁,并探讨了大语言模型对对抗性知识的鲁棒性。

原文摘要 · Abstract (English)

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by retrieving external data to mitigate hallucinations and outdated knowledge issues. Benefiting from the strong ability in facilitating diverse data sources and supporting faithful reasoning, knowledge graphs (KGs) have been increasingly adopted in RAG systems, giving rise to KG-based RAG (KG-RAG) methods. Though RAG systems are widely applied in various applications, recent studies have also revealed its vulnerabilities to data poisoning attacks, where malicious information injected into external knowledge sources can mislead the system into producing incorrect or harmful responses. However, these studies focus exclusively on RAG systems using unstructured textual data sources, leaving the security risks of KG-RAG largely unexplored, despite the fact that KGs present unique vulnerabilities due to their structured and editable nature. In this work, we conduct the first systematic investigation of the security issue of KG-RAG methods through data poisoning attacks. To this end, we introduce a practical, stealthy attack setting that aligns with real-world implementation. We propose an attack strategy that first identifies adversarial target answers and then inserts perturbation triples to complete misleading inference chains in the KG, increasing the likelihood that KG-RAG methods retrieve and rely on these perturbations during generation. Through extensive experiments on two benchmarks and four recent KG-RAG methods, our attack strategy demonstrates strong effectiveness in degrading KG-RAG performance, even with minimal KG perturbations. In-depth analyses are also conducted to understand the safety threats within the internal stages of KG-RAG systems and to explore the robustness of LLMs against adversarial knowledge.

知识图谱安全攻防RAG

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。