arXiv:2601.12331cs.CRcs.AI2026-01被引 5

提出高效隐私保护检索增强生成框架,支持云端安全查询。

Efficient Privacy-Preserving Retrieval Augmented Generation with Distance-Preserving Encryption

  • 用距离保序加密保护向量,仅保留相对距离顺序。
  • 在云上实现相似性计算,延迟低于10毫秒,准确率超90%。
  • 适合资源有限但需数据安全的个人或小团队使用。

RAG已成为提升大模型响应质量且无需高算力成本的关键技术。传统架构中,RAG服务由单一实体提供,其数据托管于可信本地环境。然而,个人或小型组织常因缺乏存储资源而依赖外部云服务,由此引入隐私风险。基于嵌入的检索机制在RAG系统中普遍应用,但易受向量到文本重构攻击及向量分析导致的结构泄露。现有隐私保护方案多依赖部分同态加密,计算开销大。为此,我们提出针对不可信云环境的高效隐私保护RAG框架(ppRAG),可抵御向量到文本攻击、向量分析及查询分析。提出条件近似距离比较保序对称加密(CAPRISE),在加密嵌入后仍允许云端计算查询与数据库嵌入间的相似性,仅保留查询与各数据库嵌入的相对距离排序,不暴露数据库间距离关系,从而兼顾隐私与效率。为缓解查询分析,引入差分隐私(DP)对查询嵌入加噪,防止云端推断敏感模式。实验表明,ppRAG具备高效处理吞吐量、高检索准确率与强隐私保障,是资源受限用户获取安全云增强大模型的可行方案。

原文摘要 · Abstract (English)

RAG has emerged as a key technique for enhancing response quality of LLMs without high computational cost. In traditional architectures, RAG services are provided by a single entity that hosts the dataset within a trusted local environment. However, individuals or small organizations often lack the resources to maintain data storage servers, leading them to rely on outsourced cloud storage. This dependence on untrusted third-party services introduces privacy risks. Embedding-based retrieval mechanisms, commonly used in RAG systems, are vulnerable to privacy leakage such as vector-to-text reconstruction attacks and structural leakage via vector analysis. Several privacy-preserving RAG techniques have been proposed but most existing approaches rely on partially homomorphic encryption, which incurs substantial computational overhead. To address these challenges, we propose an efficient privacy-preserving RAG framework (ppRAG) tailored for untrusted cloud environments that defends against vector-to-text attack, vector analysis, and query analysis. We propose Conditional Approximate Distance-Comparison-Preserving Symmetric Encryption (CAPRISE) that encrypts embeddings while still allowing the cloud to compute similarity between an encrypted query and the encrypted database embeddings. CAPRISE preserves only the relative distance ordering between the encrypted query and each encrypted database embedding, without exposing inter-database distances, thereby enhancing both privacy and efficiency. To mitigate query analysis, we introduce DP by perturbing the query embedding prior to encryption, preventing the cloud from inferring sensitive patterns. Experimental results show that ppRAG achieves efficient processing throughput, high retrieval accuracy, strong privacy guarantees, making it a practical solution for resource-constrained users seeking secure cloud-augmented LLMs.

隐私计算RAG加密检索差分隐私

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。