用隐私计算实现跨组织检索增强生成,保护数据隐私的同时提升问答准确性。
C-FedRAG: A Confidential Federated Retrieval-Augmented Generation System
- 结合隐私计算与联邦学习,实现跨组织数据安全协作的检索增强生成。
- 在MedRAG工具和MIRAGE数据集上验证系统性能,保障上下文隐私不泄露。
- 适合需跨机构共享数据但受限于隐私政策的医疗、金融等场景使用。
希望利用大语言模型进行知识查询与分析的组织常面临如何维护一个针对特定领域且信息最新的微调模型的挑战,以确保回答的相关性与真实性。检索增强生成(RAG)已成为克服专有模型维护难题、减少大模型幻觉的有效方案。然而,RAG在跨多层级访问权限和异构数据源扩展数据管道时存在困难。许多场景下,需要查询多个数据孤岛才能提供更丰富、更相关的上下文。跨组织信任边界的数据分析通常受限于复杂的数据共享政策,禁止集中存储数据,从而阻碍了RAG系统的快速部署与扩展。本文提出将可信计算(CC)技术应用于联邦检索增强生成(FedRAG),构建了一个保密的联邦检索增强生成系统(C-FedRAG)。该系统通过确保上下文隐私,实现去中心化数据提供者间RAG工作流的安全连接与扩展。我们还展示了如何基于NVIDIA FLARE SDK实现该系统,并使用MedRAG工具包和MIRAGE基准数据集评估其性能。
原文摘要 · Abstract (English)
Organizations seeking to utilize Large Language Models (LLMs) for knowledge querying and analysis often encounter challenges in maintaining an LLM fine-tuned on targeted, up-to-date information that keeps answers relevant and grounded. Retrieval Augmented Generation (RAG) has quickly become a feasible solution for organizations looking to overcome the challenges of maintaining proprietary models and to help reduce LLM hallucinations in their query responses. However, RAG comes with its own issues regarding scaling data pipelines across tiered-access and disparate data sources. In many scenarios, it is necessary to query beyond a single data silo to provide richer and more relevant context for an LLM. Analyzing data sources within and across organizational trust boundaries is often limited by complex data-sharing policies that prohibit centralized data storage, therefore, inhibit the fast and effective setup and scaling of RAG solutions. In this paper, we introduce Confidential Computing (CC) techniques as a solution for secure Federated Retrieval Augmented Generation (FedRAG). Our proposed Confidential FedRAG system (C-FedRAG) enables secure connection and scaling of a RAG workflows across a decentralized network of data providers by ensuring context confidentiality. We also demonstrate how to implement a C-FedRAG system using the NVIDIA FLARE SDK and assess its performance using the MedRAG toolkit and MIRAGE benchmarking dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。