用正常提问悄悄偷取RAG系统的内部知识,攻击隐蔽难防。
Silent Leaks: Implicit Knowledge Extraction Attack on RAG Systems through Benign Queries
- 通过自然查询包装关键词,伪装成普通提问
- 在多种防御下提取效率超基线80%,成功率超90%
- 可生成替代系统,适合研究隐私与版权风险者
检索增强生成(RAG)系统通过引入外部知识库提升大模型能力,但可能面临知识泄露攻击,引发版权与隐私风险。现有方法多依赖恶意输入(如提示注入),易被检测。本文提出隐式知识提取攻击(IKEA),利用正常查询实现知识窃取。IKEA首先以与内部知识相关的锚点关键词生成看似自然的查询,再设计两种机制:(1)经验反射采样,基于历史问答记录选择相关锚点;(2)信任区域定向变异,在相似性约束下迭代修改锚点,深入挖掘嵌入空间。大量实验表明,IKEA在多种防御下仍具高效性,提取效率超越基线80%以上,攻击成功率超90%。基于IKEA提取构建的替代RAG系统性能接近原系统,并在多项任务中优于基线方法,凸显了RAG系统潜在的隐蔽侵权风险。
原文摘要 · Abstract (English)
Retrieval-Augmented Generation (RAG) systems enhance large language models (LLMs) by incorporating external knowledge bases, but this may expose them to extraction attacks, leading to potential copyright and privacy risks. However, existing extraction methods typically rely on malicious inputs such as prompt injection or jailbreaking, making them easily detectable via input- or output-level detection. In this paper, we introduce Implicit Knowledge Extraction Attack (IKEA), which conducts Knowledge Extraction on RAG systems through benign queries. Specifically, IKEA first leverages anchor concepts-keywords related to internal knowledge-to generate queries with a natural appearance, and then designs two mechanisms that lead anchor concepts to thoroughly "explore" the RAG's knowledge: (1) Experience Reflection Sampling, which samples anchor concepts based on past query-response histories, ensuring their relevance to the topic; (2) Trust Region Directed Mutation, which iteratively mutates anchor concepts under similarity constraints to further exploit the embedding space. Extensive experiments demonstrate IKEA's effectiveness under various defenses, surpassing baselines by over 80% in extraction efficiency and 90% in attack success rate. Moreover, the substitute RAG system built from IKEA's extractions shows comparable performance to the original RAG and outperforms those based on baselines across multiple evaluation tasks, underscoring the stealthy copyright infringement risk in RAG systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。