arXiv:2608.21750cs.CL2026-08中稿 · EMNLP被引 3

通过轻量控制器实现多段落知识融合,提升大模型问答准确率

FCPRAG: Fusion-Controller Parametric Retrieval-Augmented Generation for Stable Multi-Passage LoRA Injection

论文配图:FCPRAG: Fusion-Controller Parametric Retrieval-Augmented Generation for Stable Multi-Passage LoRA Injection
图 1 · 摘自论文原文
  • 引入轻量控制器动态调节多段落知识的融合权重
  • 在多个数据集上最高提升7.55%准确率,且减少调参成本
  • 适合需要稳定多源信息融合的复杂问答场景

参数化检索增强生成(PRAG)通过特定段落的LoRA适配器将检索到的证据注入大语言模型,降低对长上下文提示的依赖。当同一查询检索到多个段落时,证据级融合成为瓶颈:等权合并会放大弱或冲突的证据,而将检索信号转化为融合权重通常需要脆弱的全局调优。我们提出FCPRAG,一种融合控制的参数化RAG框架,增加轻量控制器以实现基于检索条件的样本级适配器融合。控制器预测每段融合得分及样本级校准信号,包括混合门和自适应温度,使融合在信息丰富时保持选择性,在不确定时保持保守。FCPRAG使用仅来自训练数据的、基于适配器边际贡献的合并感知监督进行训练。进一步表明,单一数据集级温度在异方差检索不确定性下表现不佳,需样本级适应。在HotpotQA、2WikiMultiHopQA、PopQA和ComplexWebQuestions(CWQ)四个数据集上,使用三种LLM骨干网络的实验显示,FCPRAG持续优于标准RAG和参数化RAG基线,最高在2WikiMultiHopQA上提升4.65%,在CWQ上提升7.55%,同时降低调参成本并提升在检索扰动下的鲁棒性。

原文摘要 · Abstract (English)

Parametric retrieval-augmented generation (PRAG) injects retrieved evidence into a large language model (LLM) through passage-specific LoRA adapters, reducing reliance on long in-context prompts. When multiple passages are retrieved for the same query, however, evidence-level fusion becomes a bottleneck: equal-weight merging can amplify weak or conflicting evidence, and translating retrieval signals into fusion weights often requires fragile global tuning. We propose FCPRAG, a fusion-controlled parametric RAG framework that adds a lightweight controller for retrieval-conditioned, sample-level adapter fusion. The controller predicts per-passage fusion scores together with sample-level calibration signals, including a mixing gate and an adaptive temperature, enabling fusion that stays selective under informative retrieval signals and conservative under uncertainty. FCPRAG is trained with merge-aware supervision derived from each adapter's marginal contribution within a multi-adapter merge, using training data only. We further show that a single dataset-level temperature is suboptimal under heteroscedastic retrieval uncertainty, motivating sample-level adaptation. Experiments on HotpotQA, 2WikiMultiHopQA, PopQA, and ComplexWebQuestions (CWQ) across three LLM backbones show that FCPRAG consistently improves F1 over standard RAG and parametric RAG baselines, with gains of up to 4.65% on 2WikiMultiHopQA and 7.55% on CWQ, while also reducing tuning cost and improving robustness under retrieval perturbations.

检索增强LoRA融合大模型推理问答系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。