提出双向排序防御机制,有效抵御RAG系统中毒攻击
BiRD: A Bidirectional Ranking Defense Mechanism for Retrieval Augmented Generation

- 利用前向与反向排序一致性差异识别恶意文档
- 在3个数据集上使攻击成功率降低54%,任务准确率提升56%
- 仅增加不到1秒延迟,适合实际部署的RAG系统
检索增强生成(RAG)日益普及,随之而来的对抗攻击也显著增多。现有防御方法依赖语义分析或投票,存在计算开销高且对强毒化攻击鲁棒性不足的问题。其根本局限在于仅关注语义相关性,忽视了由排序结构定义的关键检索上下文。本文研究中毒与正常文档的双向排序行为,发现关键判别模式:中毒文档的反向排序与查询前向排序具有更强的一致性。基于此,提出BiRD,一种双信号框架下的双向排序防御机制,通过前向排序评估语义相关性,反向排序衡量排序上下文一致性。该设计直接解决先前方法的根本缺陷,实现高效与鲁棒性的统一。在3个数据集、3种检索器和3种LLM上,2种攻击场景下的广泛评估验证了BiRD的有效性。结果显示,BiRD将PoisonedRAG的攻击成功率降低最高54%,同时任务准确率提升最高56%,平均额外延迟低于1秒。
原文摘要 · Abstract (English)
The growing adoption of Retrieval-Augmented Generation (RAG) has led to a rise in adversarial attacks. Existing defenses, relying on semantic analysis or voting, face a trade-off between high computational cost and limited robustness under strong poisoning attacks. Their fundamental limitation is the exclusive focus on semantic content relevance, while neglecting the retrieval context that is critically defined by ranking structures. To this end, we investigate the bidirectional ranking behavior of poisoned and benign documents, and discover a key discriminative pattern: poisoned documents exhibit significantly stronger alignment between their backward rankings and the query's forward ranking. Capitalizing on this, we propose BiRD, a bidirectional ranking defense mechanism built upon a dual-signal framework that leverages forward ranking to assess semantic content relevance and backward ranking to quantify ranking context consistency. This design directly addresses the fundamental limitation of prior approaches, enabling simultaneous efficiency and robustness. Extensive evaluation across 3 datasets with 3 retrievers and 3 LLMs under 2 attack scenarios validates BiRD's effectiveness. Notably, BiRD reduces the attack success rate of PoisonedRAG by up to 54% while simultaneously improving task accuracy by up to 56%, with average additional latency under 1 second.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。