arXiv:2508.20083cs.CRcs.CL2025-08中稿 · ACM CCS 2026被引 2

攻击检索增强生成系统的检索器,让大模型无法自我纠正。

DisarmRAG: Stealthy Retriever-Centric Poisoning to Disable Self-Correction in Retrieval-Augmented Generation (Extended Version)

  • 聚焦检索器而非知识库,注入反自我修正指令
  • 六种大模型测试成功率超90%,效果显著
  • 隐蔽性强,可绕过多种检测防御,适合真实场景攻击研究

检索增强生成(RAG)已成为提升大语言模型(LLM)可靠性的重要方法。已有研究显示,通过污染知识库可误导RAG系统生成攻击者指定的输出。然而我们发现,在实际部署中,由于大模型具备强大的自我修正能力(SCA),此类攻击效果大幅削弱。这一现象揭示了理想化研究环境与真实场景间的巨大差距。为解决此问题,我们系统分析了现有攻击的局限性,提出新型毒化范式DisarmRAG,其核心在于攻击检索器而非传统意义上的知识库。通过破坏检索器,该方法能将任意反自我修正指令注入给LLM的上下文,有效抑制其自我修正能力,强制输出攻击者指定内容。具体实现包括:1)迭代协同优化机制以确保反自修正指令的有效性;2)基于对比学习的隐蔽模型编辑技术,实现攻击载荷的高效传递。我们在六个主流大模型和三个问答基准上进行了广泛评估,结果显示成功率超过90%。此外,该攻击在多种检测防御下仍具有效性,凸显其隐蔽性,这对真实世界攻击具有重要意义。

原文摘要 · Abstract (English)

Retrieval-Augmented Generation (RAG) has become a standard approach for improving the reliability of large language models (LLMs). Prior work demonstrates the vulnerability of RAG systems by misleading them into generating attacker-chosen outputs through poisoning the knowledge base. However, we observe that the effectiveness of these attacks is substantially undermined in the real-world deployment, where LLMs exhibit a strong self-correction ability (SCA). This ability is typically triggered by the mainstream configuration of LLMs, indicating a substantial gap between idealized research settings and practical scenarios. To address this issue, we systematically reflect on the limitations of prior RAG attacks and introduce DisarmRAG, a novel poisoning paradigm that focuses on the retriever, instead of the conventional approach of only poisoning the knowledge base. By compromising the retriever, our method can inject arbitrary anti-SCA instructions into the context provided to LLMs, effectively suppressing the SCA and enforcing attacker-chosen outputs. In particular, we craft a novel and systematic attack framework consisting of 1) an iterative co-optimization process to ensure the effectiveness of the anti-SCA instructions and 2) a stealthy model editing technique based on contrastive learning to facilitate the delivery of the attack payload. We extensively evaluate DisarmRAG across six LLMs and three QA benchmarks, and the results, with success rates exceeding 90%, confirm its efficacy. We additionally validate the effectiveness of our attack under various detection defenses, highlighting stealthiness, which is another critical aspect to consider in real-world attacks.

RAG安全模型攻击自我修正隐蔽攻击

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。