arXiv:2607.03456cs.IR2026-07

提出句子级黑盒攻击方法,让无关文档骗过密集检索模型。

SentAttack: A Sentence-Level Black-Box Adversarial Attack Method for Dense Retrieval Models

  • 两阶段攻击:先训练替代模型,再用聚类中心生成对抗候选。
  • 在低排名文档上显著提升其排名,成功率超现有方法。
  • 适合研究检索模型安全性的研究人员,尤其关注黑盒攻击。

检索增强生成(RAG)系统通常包含密集检索(DR)模型和神经重排(NRM)模型。现有鲁棒性研究多聚焦于NRM,而对DR模型的对抗攻击大多限于词级扰动。对于与查询无关的低排名目标文档,简单词级攻击难以有效误导DR模型。为此,我们提出SentAttack,一种针对DR模型的句子级黑盒对抗攻击方法。该方法为两阶段设计:第一阶段通过迭代检索与黑盒RAG系统交互,收集排序文档及信息,用于训练代理DR模型;第二阶段利用代理模型编码并聚类与目标查询相关的文档,得到多个聚类中心,将这些中心与目标文档在句子层面拼接,形成初始对抗候选集。随后,结合查询与中心引导的目标函数,采用梯度引导的束搜索优化候选集。大量实验表明,SentAttack在各类场景下优于现有DR模型攻击方法,尤其在低排名目标文档上表现突出。

原文摘要 · Abstract (English)

Retrieval-Augmented Generation (RAG) systems typically consist of a dense retrieval (DR) model for initial retrieval and a neural ranking model (NRM) for re-ranking.Existing robustness studies in RAG mainly focus on NRMs, while adversarial attacks on DR models are mostly limited to word-level perturbations.For low-ranked target documents that are irrelevant to the query, simple word-level attacks are insufficient to mislead DR models into substantially promoting their rankings.To solve these problems, we propose SentAttack, a sentence-level black-box adversarial attack method for DR models.SentAttack is designed as a two-stage method.In the first stage, SentAttack interacts with the black-box RAG system via iterative retrieval to collect ranked documents and ranking information for training a surrogate DR model.In the second stage, SentAttack uses the surrogate DR model to encode and cluster documents relevant to the target query, yielding multiple cluster centroids.These centroids are concatenated with the target document at the sentence level to form an initial set of adversarial candidates.SentAttack then optimizes these candidates using a query- and centroid-guided objective combined with gradient-guided beam search.Extensive experiments demonstrate that SentAttack outperforms existing adversarial attacks on DR models, with especially strong performance on low-ranked target documents.

对抗攻击检索模型黑盒攻击RAG

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。