arXiv:2412.20953cs.CRcs.CL2024-12中稿 · ACM CCS 2025被引 23

提出新型攻击方法,揭示密集嵌入检索系统在特定查询下的严重脆弱性。

GASLITEing the Retrieval: Exploring Vulnerabilities in Dense Embedding-based Search

  • 设计GASLITE攻击,无需修改模型或依赖语料库内容生成高排名恶意片段
  • 实测显示0.0001%的污染率即可让检索系统失效,且跨语料库泛化性强
  • 适用于研究检索系统安全性的研究人员,尤其关注对抗攻击与RAG可靠性

基于密集嵌入的文本检索通过深度学习编码实现高效相关段落召回,已成为当前先进搜索技术的核心,并推动了检索增强生成(RAG)的发展。然而,此类检索系统可能面临搜索引擎优化(SEO)攻击:攻击者通过向语料库中注入对抗性段落,诱导恶意内容被优先召回。已有工作虽证明此类攻击可行,但多聚焦于集成检索的系统(如RAG),且采用宽松的威胁模型、基础攻击方法,评估规模有限,难以全面理解检索器最坏情况下的表现。本文旨在真实、系统地评估检索器的鲁棒性,揭示其对SEO攻击的敏感因素。首先,提出GASLITE攻击方法,可在不依赖语料内容或修改模型的前提下,将攻击者指定信息嵌入高排名段落,持续优于先前方法;其次,利用GASLITE对九种先进检索模型在多种威胁模型下进行广泛评估,重点关注针对特定概念(如公众人物)的查询攻击。结果表明:即使在极低污染率(如≥0.0001%语料比例)下,检索器对概念特定查询仍高度易受攻击,且具备跨语料库和查询分布的泛化能力;单查询攻击可被完全破解;自适应攻击能绕过常见防御机制。

原文摘要 · Abstract (English)

Dense embedding-based text retrieval$\unicode{x2013}$retrieval of relevant passages from corpora via deep learning encodings$\unicode{x2013}$has emerged as a powerful method attaining state-of-the-art search results and popularizing Retrieval Augmented Generation (RAG). Still, like other search methods, embedding-based retrieval may be susceptible to search-engine optimization (SEO) attacks, where adversaries promote malicious content by introducing adversarial passages to corpora. Prior work has shown such SEO is feasible, mostly demonstrating attacks against retrieval-integrated systems (e.g., RAG). Yet, these consider relaxed SEO threat models (e.g., targeting single queries), use baseline attack methods, and provide small-scale retrieval evaluation, thus obscuring our comprehensive understanding of retrievers' worst-case behavior. This work aims to faithfully and thoroughly assess retrievers' robustness, paving a path to uncover factors related to their susceptibility to SEO. To this end, we, first, propose the GASLITE attack for generating adversarial passages, that$\unicode{x2013}$without relying on the corpus content or modifying the model$\unicode{x2013}$carry adversary-chosen information while achieving high retrieval ranking, consistently outperforming prior approaches. Second, using GASLITE, we extensively evaluate retrievers' robustness, testing nine advanced models under varied threat models, while focusing on pertinent adversaries targeting queries on a specific concept (e.g., a public figure). Amongst our findings: retrievers are highly vulnerable to SEO against concept-specific queries, even under negligible poisoning rates (e.g., $\geq$0.0001% of the corpus), while generalizing across different corpora and query distributions; single-query SEO is completely solved by GASLITE; adaptive attacks demonstrate bypassing common defenses; [...]

检索安全对抗攻击RAG

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。