arXiv:2509.23519cs.CRcs.AI2025-09NeurIPS被引 21

通过文档可靠性信息提升RAG搜索抗攻击能力,实现可证明的鲁棒性。

ReliabilityRAG: Effective and Provably Robust Defense for RAG-based Web-Search

  • 构建文档矛盾图,用最大独立集筛选可信内容。
  • 在10万级检索结果中保持高鲁棒性,误判率低于5%。
  • 适合需要安全生成的长文本场景,如AI搜索摘要。

检索增强生成(RAG)通过引入外部文档提升大模型输出质量,但其检索语料易受攻击,如提示注入。针对基于RAG的网络搜索系统(如Google Search AI Overview),本文提出ReliabilityRAG框架,利用文档排序等内置可靠性信号实现对抗鲁棒性。首先,从图论角度建模文档间矛盾关系,设计一种优先高可靠文档的最大独立集(MIS)算法,在自然假设下对有限范围攻击提供可证明鲁棒性保障。其次,为应对大规模检索的计算开销,提出加权采样聚合的可扩展框架,保留部分鲁棒性同时高效处理大量文档。实验表明,相比已有方法,ReliabilityRAG在对抗攻击下表现更优,良性准确率高,且在长文本生成任务中显著优于以往专注鲁棒性的方法。本工作为应对RAG检索语料污染提供了有效、可证明鲁棒的防御方案。

原文摘要 · Abstract (English)

Retrieval-Augmented Generation (RAG) enhances Large Language Models by grounding their outputs in external documents. These systems, however, remain vulnerable to attacks on the retrieval corpus, such as prompt injection. RAG-based search systems (e.g., Google's Search AI Overview) present an interesting setting for studying and protecting against such threats, as defense algorithms can benefit from built-in reliability signals -- like document ranking -- and represent a non-LLM challenge for the adversary due to decades of work to thwart SEO. Motivated by, but not limited to, this scenario, this work introduces ReliabilityRAG, a framework for adversarial robustness that explicitly leverages reliability information of retrieved documents. Our first contribution adopts a graph-theoretic perspective to identify a "consistent majority" among retrieved documents to filter out malicious ones. We introduce a novel algorithm based on finding a Maximum Independent Set (MIS) on a document graph where edges encode contradiction. Our MIS variant explicitly prioritizes higher-reliability documents and provides provable robustness guarantees against bounded adversarial corruption under natural assumptions. Recognizing the computational cost of exact MIS for large retrieval sets, our second contribution is a scalable weighted sample and aggregate framework. It explicitly utilizes reliability information, preserving some robustness guarantees while efficiently handling many documents. We present empirical results showing ReliabilityRAG provides superior robustness against adversarial attacks compared to prior methods, maintains high benign accuracy, and excels in long-form generation tasks where prior robustness-focused methods struggled. Our work is a significant step towards more effective, provably robust defenses against retrieved corpus corruption in RAG.

RAG对抗攻击可靠性图神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。