提出轻量级防御机制,有效抵御RAG系统中的知识污染攻击。
Rescuing the Unpoisoned: Efficient Defense against Knowledge Corruption Attacks on RAG Systems
- 在检索后阶段使用轻量机器学习检测并过滤恶意内容。
- 对Gemini模型攻击成功率从0.89降至0.02,优于现有方法。
- 无需额外训练,适合实际部署场景,计算开销低。
大型语言模型(LLM)正广泛应用于各类网络服务,但存在生成幻觉和缺乏实时信息等问题。为解决此问题,检索增强生成(RAG)通过外部知识源生成更可靠的回答,典型RAG系统包含检索器和生成器两部分。然而,近期研究揭示了RAG系统的脆弱性,如通过注入误导信息实施的知识污染攻击。现有防御方法如逐项审查或微调检索器虽有效,但计算成本高。本文提出RAGDefender,一种资源高效的防御机制,可在检索后阶段利用轻量机器学习技术检测并过滤对抗性内容,无需额外训练或推理。实验证明,RAGDefender在多模型与攻击场景下均显著优于现有先进防御方法:例如当恶意段落数量为合法段落的4倍时,对Gemini模型的攻击成功率达0.02,远低于RobustRAG的0.69和Discern-and-Answer的0.24。
原文摘要 · Abstract (English)
Large language models (LLMs) are reshaping numerous facets of our daily lives, leading widespread adoption as web-based services. Despite their versatility, LLMs face notable challenges, such as generating hallucinated content and lacking access to up-to-date information. Lately, to address such limitations, Retrieval-Augmented Generation (RAG) has emerged as a promising direction by generating responses grounded in external knowledge sources. A typical RAG system consists of i) a retriever that probes a group of relevant passages from a knowledge base and ii) a generator that formulates a response based on the retrieved content. However, as with other AI systems, recent studies demonstrate the vulnerability of RAG, such as knowledge corruption attacks by injecting misleading information. In response, several defense strategies have been proposed, including having LLMs inspect the retrieved passages individually or fine-tuning robust retrievers. While effective, such approaches often come with substantial computational costs. In this work, we introduce RAGDefender, a resource-efficient defense mechanism against knowledge corruption (i.e., by data poisoning) attacks in practical RAG deployments. RAGDefender operates during the post-retrieval phase, leveraging lightweight machine learning techniques to detect and filter out adversarial content without requiring additional model training or inference. Our empirical evaluations show that RAGDefender consistently outperforms existing state-of-the-art defenses across multiple models and adversarial scenarios: e.g., RAGDefender reduces the attack success rate (ASR) against the Gemini model from 0.89 to as low as 0.02, compared to 0.69 for RobustRAG and 0.24 for Discern-and-Answer when adversarial passages outnumber legitimate ones by a factor of four (4x).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。