arXiv:2608.23965cs.CRcs.AI2026-08

通过几何一致性检测,精准识别并剔除恶意注入的误导文档。

RAGSentinel: Certifiable Geometric Consensus for Robust Retrieval-Augmented Generation

论文配图:RAGSentinel: Certifiable Geometric Consensus for Robust Retrieval-Augmented Generation
图 1 · 摘自论文原文
  • 利用查询条件下的隐藏状态偏移,检测文档异常
  • 在三个数据集上攻击成功率低于5%,保持高准确率
  • 无需训练、无需标签,适合黑盒RAG系统防御

检索增强生成(RAG)通过外部文档提升大模型事实性,但知识库中注入的恶意文档可引导模型输出错误答案。现有防御依赖指令遵循或文本一致性,易被自适应攻击绕过。本文提出RAGSentinel,一种无需训练、无需标签的黑盒RAG防御方法。它通过代理编码器测量检索文档引起的查询相关隐藏状态偏移,去除共现主题方向,基于鲁棒多数共识将污染文档识别为几何离群点。理论证明,在诚实多数假设与表示层分离条件下,RAGSentinel可精确恢复无毒多数规模上下文。在三个问答数据集、三类LLM及多种投毒攻击下,RAGSentinel始终实现低于5%的攻击成功率,同时保持良好准确性,并对具备完整攻击链知识的自适应攻击有效。

原文摘要 · Abstract (English)

Retrieval-augmented generation (RAG) improves the factuality of large language models by grounding responses in external documents, but it also exposes a critical security vulnerability: adversarial documents injected into the knowledge database can enter the context window and steer the model toward targeted incorrect answers. Existing post-retrieval defenses rely on instruction following, parametric knowledge, or text-level consistency, all of which can be imitated or optimized against by adaptive attackers. We propose RAGSentinel, a training-free, label-free defense for black-box RAG systems. RAGSentinel uses a surrogate encoder to measure query-conditioned hidden-state shifts induced by retrieved documents, removes shared topic directions, and filters poisoned documents as geometric outliers from a robust majority consensus. We prove that, under an honest-majority assumption and a representation-level separation condition, RAGSentinel exactly recovers a poison-free majority-sized context. Experiments across three question-answering datasets, three LLM families, and multiple poisoning attacks show that RAGSentinel consistently achieves low attack success rates while preserving competitive accuracy and remaining effective against adaptive attacks with full pipeline knowledge.

RAG安全对抗防御几何检测无监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。