用提示增强+低秩微调,让医学问答更准更快。
P-RAG: Prompt-Enhanced Parametric RAG with LoRA and Selective CoT for Biomedical and Multi-Hop QA
- 将检索知识与模型参数结合,用思维链引导推理。
- 医学数据集上准确率提升10.47个百分点,多跳问题得分翻倍。
- 适合医疗、科研等需要复杂推理的精准问答场景。
大语言模型受限于静态训练数据,检索增强生成(RAG)通过推理时引入外部知识缓解此问题,但仍依赖知识库质量。本文提出混合架构P-RAG,融合模型参数化知识与检索证据,结合思维链(CoT)提示和低秩适配(LoRA)微调,在通用与生物医学数据集上评估。基于LoRA微调的LLaMA-3.2-1B-Instruct在PubMedQA上表现优于标准RAG,F1达93.33%(对比82.86%),相对提升12.64%;在2WikiMultihopQA上,总分33.44%(标准RAG为17.83%),其中比较子集达44.03%(桥接42.74%,推断21.84%,组合8.60%)。思维链显著提升多跳推理能力,但对简单单跳查询效果不一。本工作贡献包括:(1) 面向生物医学问答的LLaMA-3.2-1B-Instruct LoRA微调方案;(2) 提出带思维链提示的P-RAG框架;(3) 在PubMedQA和2WikiMultihopQA上达到当前最优结果。
原文摘要 · Abstract (English)
Large Language Models (LLMs) demonstrate remarkable capabilities but remain limited by their reliance on static training data. Retrieval-Augmented Generation (RAG) addresses this constraint by retrieving external knowledge during inference, though it still depends heavily on knowledge base quality. To explore potential improvements, we evaluated three RAG variants-Standard RAG, DA-RAG, and our proposed Prompt-Enhanced Parametric RAG (P-RAG), a hybrid architecture that integrates parametric knowledge within the LLM and retrieved evidence, guided by Chain-of-Thought (CoT) prompting and Low-Rank Adaptation (LoRA) fine-tuning-on both general and biomedical datasets. Using LLaMA-3.2-1B-Instruct fine-tuned via LoRA, we evaluate on PubMedQA and 2WikiMultihopQA. P-RAG outperforms Standard RAG on PubMedQA by 10.47 percentage points in F1 (93.33% vs. 82.86%; 12.64% relative). On 2WikiMultihopQA, P-RAG nearly doubles the overall score vs. Standard RAG (33.44% vs. 17.83%) and achieves 44.03% on the Compare subset (with 42.74% Bridge, 21.84% Inference, 8.60% Compose). CoT prompting substantially improves multi-hop reasoning but yields mixed results for simpler, single-hop queries. These findings underscore P-RAG's potential for accurate, scalable, and contextually adaptive biomedical question answering. Our contributions include: (1) LoRA-based fine-tuning of LLaMA-3.2-1B-Instruct for biomedical QA, (2) introduction of P-RAG with Chain-of-Thought prompting, and (3) state-of-the-art results on PubMedQA and 2WikiMultihopQA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。