提出高效隐私保护检索系统,支持任意规模的top-k文档查找。
P$^2$RAG: Efficient Privacy-Preserving RAG Service Supporting Arbitrary Top-$k$ Retrieval
- 用交互式二分法替代排序,实现任意k值的快速检索。
- 在k=16到1024时,速度比现有最优系统快3至300倍。
- 适用于金融、医疗等需大k值且重视隐私的场景。
检索增强生成(RAG)使大语言模型能调用外部知识,但外包RAG服务会引发数据所有者和用户双方的隐私担忧。现有隐私保护RAG系统通过安全排序实现顶k检索,但难以支持任意k值,存在无法调整k、新安全漏洞及大k值下效率严重下降的问题。这一缺陷尤为突出,因金融、法律、医疗等领域需较大k值以保障准确性,而现代长上下文模型也依赖更大检索集提升效果。本文提出P²RAG,一种支持任意顶k检索的高效隐私保护RAG服务。与现有方法不同,P²RAG避免对候选文档进行排序,转而采用交互式二分法确定前k个相关文档。为保障安全,系统在两个非共谋半诚实服务器间使用秘密共享机制,保护数据所有者的数据库和用户的查询请求。同时引入限制与验证机制,防范恶意用户,并严格控制数据库信息泄露。实验表明,在k=16至1024范围内,P²RAG相较当前最优系统PRAG提速达3至300倍。
原文摘要 · Abstract (English)
Retrieval-Augmented Generation (RAG) enables large language models to use external knowledge, but outsourcing the RAG service raises privacy concerns for both data owners and users. Privacy-preserving RAG systems address these concerns by performing secure top-$k$ retrieval, which is typically implemented using secure sorting to identify relevant documents. However, existing systems face challenges supporting arbitrary $k$ due to their inability to change $k$, new security issues, and in particular, efficiency degradation with large $k$. This is a significant limitation because applications such as finance, law, and healthcare require a $k$ that is large enough to cause huge overhead for existing systems. Also, modern long-context models generally achieve higher accuracy with larger retrieval sets. We propose P$^2$RAG, an efficient privacy-preserving RAG service that supports arbitrary top-$k$ retrieval. Unlike existing systems, P$^2$RAG avoids sorting candidate documents. Instead, it uses an interactive bisection method to determine the set of top-$k$ documents. For security, P$^2$RAG uses secret sharing on two semi-honest non-colluding servers to protect the data owner's database and the user's prompt. It enforces restrictions and verification to defend against malicious users and tightly bounds the information leakage of the database. The experiments show that P$^2$RAG is 3--300$\times$ faster than the state-of-the-art PRAG for $k = 16$--$1024$.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。