arXiv:2609.04767cs.AI2026-09

用生成的影子查询替代原始嵌入,提升向量库隐私性。

Shadow Queries for Private Retrieval in Vector Databases

论文配图:Shadow Queries for Private Retrieval in Vector Databases
图 1 · 摘自论文原文
  • 用语言模型生成多样影子查询,拆分文档语义并解耦嵌入与原文
  • 攻击恢复率低至0.2104,比基线多防御19.50%的文本内容
  • 适合需高隐私保护的RAG系统部署

大语言模型日益依赖信息检索系统(如RAG)来引入领域知识,避免昂贵的再训练。这些系统通常将预计算的文档嵌入存储在云端向量数据库中。然而,此类嵌入易受嵌入逆向攻击(EIA)威胁,可重建原始文本。现有防御措施如加噪或缩放嵌入,往往隐私保护有限或显著降低检索效用。本文提出SHAQ(影子查询生成),一种基于语义分解和嵌入解耦的EIA防御方法。其核心思想是:EIA依赖于嵌入与原文间的强耦合。SHAQ不直接存储文档嵌入,而是利用生成式语言模型创建捕捉文档不同语义方面的多样化影子查询,并对这些查询编码后存入数据库,从而实现语义分解与嵌入解耦。在多个不同IR数据集上的实验表明,SHAQ显著提升隐私性同时保持检索效用,恢复率低至0.2104,比基线多防御19.50%的文本,且在最多5.53%的效用提升下达到0.7967的MAP@10。结果表明,语义分解与嵌入解耦是应对EIA的有效替代方案。

原文摘要 · Abstract (English)

Large language models (LLMs) increasingly rely on information retrieval (IR) systems, such as Retrieval-Augmented Generation (RAG), to incorporate domain-specific knowledge without costly re-training. These systems often store pre-computed document embeddings in cloud-based vector databases. However, such embeddings are vulnerable to embedding inversion attacks (EIAs), which can reconstruct their underlying text. Existing defenses, such as adding noise or scaling embeddings, often provide limited privacy or significantly reduce retrieval utility. We propose SHAQ (shadow query generation), a semantic-decomposition and embedding-decoupling defense against EIAs. SHAQ is based on the insight that EIAs rely on the strong coupling between an embedding and its original text. Instead of storing document embeddings directly, SHAQ uses a generative language model to create diverse shadow queries that capture different semantic aspects of each document. These queries are then encoded and stored in place of the original document embeddings, thereby decomposing document semantics and decoupling stored embeddings from the source text. Experiments across diverse IR datasets show that SHAQ substantially improves privacy while preserving retrieval utility, achieving a recovery rate as low as 0.2104, defending up to 19.50% more tokens than baseline defenses, and reaching up to 0.7967 MAP@10 with up to 5.53% utility improvement. These results demonstrate that semantic decomposition and embedding decoupling provide an effective alternative to directly modifying embeddings for defending against EIAs.

隐私保护向量数据库RAG安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。