arXiv:2509.06444cs.AI2025-09被引 6

面向医疗异构数据的联邦生成框架,保护隐私同时提升检索与生成效果。

HyFedRAG: A Federated Retrieval-Augmented Generation Framework for Heterogeneous and Privacy-Sensitive Data

  • 边缘-云端协同处理结构化、半结构化与非结构化数据,保障隐私。
  • 在PMC-Patients数据集上,检索质量与生成一致性优于基线方法。
  • 适合医疗等隐私敏感领域,支持多模态数据的高效安全推理。

集中式RAG系统在异构且隐私敏感的数据场景中面临挑战,尤其在分布式医疗环境中,患者数据涵盖SQL、知识图谱和临床笔记。由于隐私限制及传统云RAG对多样化格式和边缘设备支持不足,临床医生难以检索罕见病案例。为此,我们提出HyFedRAG,一个针对混合数据模态的统一高效联邦RAG框架。通过边缘-云端协作机制,该框架可在保护数据隐私的前提下跨多种数据源运行。主要贡献包括:(1) 基于Flower构建的边缘-云端协同RAG框架,支持查询结构化SQL数据、半结构化知识图谱及非结构化文档;边缘侧大模型将异构数据转化为标准化隐私保护表示,服务器侧大模型进行全局推理与生成。(2) 集成轻量本地检索器与隐私感知大模型,并提供三种匿名化工具,使各客户端可生成语义丰富且去标识化的摘要,用于跨设备全局推理。(3) 设计三层次缓存策略(本地缓存、中间表示缓存、云端推理缓存),优化响应延迟并减少冗余计算。在PMC-Patients数据集上的实验表明,HyFedRAG在检索质量、生成一致性和系统效率方面均优于现有基线。本框架为结构异构数据上的RAG提供了可扩展且符合隐私合规的解决方案,释放了大模型在敏感与多样化数据环境中的潜力。

原文摘要 · Abstract (English)

Centralized RAG pipelines struggle with heterogeneous and privacy-sensitive data, especially in distributed healthcare settings where patient data spans SQL, knowledge graphs, and clinical notes. Clinicians face difficulties retrieving rare disease cases due to privacy constraints and the limitations of traditional cloud-based RAG systems in handling diverse formats and edge devices. To address this, we introduce HyFedRAG, a unified and efficient Federated RAG framework tailored for Hybrid data modalities. By leveraging an edge-cloud collaborative mechanism, HyFedRAG enables RAG to operate across diverse data sources while preserving data privacy. Our key contributions are: (1) We design an edge-cloud collaborative RAG framework built on Flower, which supports querying structured SQL data, semi-structured knowledge graphs, and unstructured documents. The edge-side LLMs convert diverse data into standardized privacy-preserving representations, and the server-side LLMs integrates them for global reasoning and generation. (2) We integrate lightweight local retrievers with privacy-aware LLMs and provide three anonymization tools that enable each client to produce semantically rich, de-identified summaries for global inference across devices. (3) To optimize response latency and reduce redundant computation, we design a three-tier caching strategy consisting of local cache, intermediate representation cache, and cloud inference cache. Experimental results on PMC-Patients demonstrate that HyFedRAG outperforms existing baselines in terms of retrieval quality, generation consistency, and system efficiency. Our framework offers a scalable and privacy-compliant solution for RAG over structural-heterogeneous data, unlocking the potential of LLMs in sensitive and diverse data environments.

联邦学习RAG医疗AI隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。