arXiv:2606.18310cs.CRcs.AI2026-06

通过模型级编辑让大模型误信恶意知识,攻击检索增强系统。

Conflict-Aware Retriever Editing for Knowledge Injection Attacks on LLM-Based RAG Systems

论文配图:Conflict-Aware Retriever Editing for Knowledge Injection Attacks on LLM-Based RAG Systems
图 1 · 摘自论文原文
  • 利用图检测与参数投影实现冲突感知的检索器编辑
  • 可批量使恶意内容进入检索结果,且不影响非目标请求
  • 适合研究大模型安全与防御的开发者使用

向检索增强生成(RAG)系统注入恶意知识可操纵检索证据并误导生成结果,对AI应用构成严重威胁。现有攻击多依赖外部知识库篡改,如构造恶意语料,但合成文本易被识别导致攻击失败。除数据层面外,开源检索器正使RAG系统面临模型级攻击。本文提出冲突感知检索器编辑框架CAREATTACK,分两阶段:首先基于图检测与参数投影的闭式编辑,提升恶意知识优先级并解决参数冲突;其次通过轻量校准修复锚点,消除对非目标提示的影响,同时保持对目标提示的攻击效果。我们在Qwen3-Embedding-0.6B和BGE-M3上实现该方法,在三个基准数据集上验证其有效性。实验表明,该方法能显著提升恶意内容在检索结果中的占比,支持批量目标提示攻击,且仅需访问检索模型参数。由于多数RAG系统基于开源检索模型,本工作揭示了实际存在的攻击面。代码已公开于https://anonymous.4open.science/r/CareAttack-3F1C。

原文摘要 · Abstract (English)

Injecting malicious knowledge into retrieval-augmented generation (RAG) systems can manipulate retrieved evidence and mislead downstream generation, posing a serious security threat for AI applications. Existing RAG injection attacks mainly rely on manipulating external knowledge bases, such as crafting malicious corpus. However, the synthetic text crafted by such data-centric methods could be detectable, leading to the failure of attacks. Beyond corpus manipulation, open-source retrievers are increasingly exposing RAG systems to model-centric attacks. In this paper, we propose conflict-aware retriever editing, i.e., CAREATTACK, a model-centric retriever attack framework for malicious knowledge injection in RAG. Specifically, CAREATTACK consists two stages of conflict-aware retriever editing and attack-preserving anchor repair. Conflict-aware retriever editing adapts efficient closed-form parameter editing to the dense retrieval model, promoting malicious knowledge above benign competing passages and resolving potential parameter conflicts through graph-based conflict detection and parameter editing projection. Then, attack-preserving anchor repair performs lightweight calibration on the edited retriever to further eliminate the impact on non-target prompts while preserving the attack effectiveness for target prompts. We instantiate CAREATTACK on Qwen3-Embedding-0.6B and BGE-M3, and conduct evaluation on three benchmark datasets. Experimental results demonstrate our method substantially promote malicious passages into the retrieved knowledge of RAG systems and can perform attacks for batches of target prompts and passages, given the access of retrieval model parameters. Since most RAG systems are built upon open-source retrieval models, this work reveals a practical attack surface in RAG systems. Codes are public accessible at https://anonymous.4open.science/r/CareAttack-3F1C.

大模型安全知识注入检索增强模型攻击

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。