arXiv:2605.27432cs.IRcs.AI2026-05被引 1

让边缘设备在不共享数据的情况下高效使用外部知识,提升问答准确率并降低延迟。

FD-RAG: Federated Dual-System Retrieval-Augmented Generation

论文配图:FD-RAG: Federated Dual-System Retrieval-Augmented Generation
图 1 · 摘自论文原文
  • 分两阶段设计:本地构建轻量语义图,推理时优先查记忆库再调用大模型。
  • 相比基线模型,准确率最高提升7.8%,延迟降低8.4倍。
  • 适合隐私敏感、算力受限的边缘场景,如智能终端与物联网设备。

检索增强生成(RAG)使大语言模型能接入外部知识,但现有系统依赖集中式知识和充足算力,在边缘环境难以适用——知识分散于各设备,原始数据无法共享,频繁调用大模型代价高昂。本文提出联邦双系统RAG(FD-RAG),将轻量级记忆访问与按需大模型推理解耦,实现去中心化部署。具体地,FD-RAG在本地语料上学习语义感知的自适应超图,并将其压缩为紧凑的问答记忆库。推理时,对覆盖充分的问题直接匹配记忆库回答,仅在必要时调用大模型推理,同时追踪记忆来源至超图支撑的证据。为缓解跨设备知识碎片化问题,FD-RAG聚合匿名化记忆而不暴露原始文档。在QA基准测试中,FD-RAG相比强基线模型准确率提升最高达7.8%,延迟降低8.4倍。我们还提供了理论分析,证明所提超图学习具有$\/mathcal{O}(1/ε^{2})$收敛率,支持其在边缘场景的可行部署。

原文摘要 · Abstract (English)

Retrieval-augmented generation (RAG) has emerged as a paradigm for grounding large language models in external knowledge, yet most existing RAG systems assume centralized knowledge access and ample computation. These assumptions break down in edge environments, where knowledge is fragmented across devices, raw data cannot be shared, and repeated LLM calls are prohibitively expensive. We propose FD-RAG, a federated dual-system RAG framework that decouples lightweight memory access from on-demand LLM reasoning for decentralized deployment. Specifically, FD-RAG learns semantic-aware adaptive hypergraphs over local corpora and distills them into compact QA memories. At inference time, it answers well-covered queries via direct memory matching and invokes LLM-based reasoning only when necessary, while tracing retrieved memories to hypergraph-grounded evidence. To mitigate cross-device knowledge fragmentation, FD-RAG aggregates anonymized memories across devices without exposing raw documents. Experiments on QA benchmarks show that FD-RAG improves accuracy by up to 7.8\% while reducing latency by 8.4$\times$ compared with strong local and federated baselines. We also provide theoretical analysis establishing an $\mathcal{O}(1/ε^{2})$ convergence rate for the proposed hypergraph learning, supporting its tractable deployment in edge settings.

联邦学习RAG边缘计算知识增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。