RemoteRAG保护用户查询隐私,实现高效准确的云端文档检索。
RemoteRAG: A Privacy-Preserving LLM Cloud RAG Service
- 基于距离差分隐私设计扰动嵌入,限制搜索范围提升隐私性。
- 从10⁶文档中检索仅需0.67秒、46.66KB传输数据,性能接近无隐私方案。
- 可抵御嵌入逆向攻击,适合对隐私敏感的医疗、金融等场景使用。
检索增强生成(RAG)通过从可信文献中检索相关文档并融入用户查询上下文,提升大模型服务质量。近年来,云RAG服务使用户能便捷查询文档,但直接上传查询存在隐私泄露风险。本文首次正式定义隐私保护型云RAG服务,并提出RemoteRAG方案,在隐私、效率与准确性之间取得平衡。为保障隐私,引入$(n,ε)$-距离差分隐私(DistanceDP)刻画用户查询及关联文档的泄露风险;为提升效率,将搜索范围从全部文档缩小至由扰动嵌入生成的少量相关文档,显著降低计算与通信开销;为保证准确率,理论证明小范围仍可覆盖目标文档。实验表明,RemoteRAG能有效抵御现有嵌入逆向攻击,在多种设置下检索效果无损失。在10⁶文档规模下,仅需0.67秒和46.66KB数据传输(非优化方案为2.72小时、1.43GB),兼具高效与安全。
原文摘要 · Abstract (English)
Retrieval-augmented generation (RAG) improves the service quality of large language models by retrieving relevant documents from credible literature and integrating them into the context of the user query. Recently, the rise of the cloud RAG service has made it possible for users to query relevant documents conveniently. However, directly sending queries to the cloud brings potential privacy leakage. In this paper, we are the first to formally define the privacy-preserving cloud RAG service to protect the user query and propose RemoteRAG as a solution regarding privacy, efficiency, and accuracy. For privacy, we introduce $(n,ε)$-DistanceDP to characterize privacy leakage of the user query and the leakage inferred from relevant documents. For efficiency, we limit the search range from the total documents to a small number of selected documents related to a perturbed embedding generated from $(n,ε)$-DistanceDP, so that computation and communication costs required for privacy protection significantly decrease. For accuracy, we ensure that the small range includes target documents related to the user query with detailed theoretical analysis. Experimental results also demonstrate that RemoteRAG can resist existing embedding inversion attack methods while achieving no loss in retrieval under various settings. Moreover, RemoteRAG is efficient, incurring only $0.67$ seconds and $46.66$KB of data transmission ($2.72$ hours and $1.43$ GB with the non-optimized privacy-preserving scheme) when retrieving from a total of $10^6$ documents.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。