arXiv:2604.07274cs.CLcs.AI2026-04

系统评估医疗问答中检索组件设计,发现优化查询与重排序可显著提升准确率。

A Systematic Study of Retrieval Pipeline Design for Retrieval-Augmented Medical Question Answering

  • 构建40种配置的统一框架,测试检索流程各环节组合效果。
  • 最优方案达60.49%准确率,查询改写与交叉编码重排序提升明显。
  • 仅需消费级显卡即可完成实验,适合资源有限的研究者参考。

大型语言模型在医疗问答中表现强劲,但纯参数模型常因知识缺口和事实依据不足而受限。检索增强生成(RAG)通过在推理过程中引入外部知识检索来解决此问题。尽管基于RAG的医疗系统日益受关注,但各检索组件对性能的影响仍不明确。本研究采用MedQA USMLE基准与结构化教科书知识语料库,系统评估了语言模型、嵌入模型、检索策略、查询改写及交叉编码重排序在统一框架下的交互作用。共测试40种配置,结果表明检索增强显著提升零样本医疗问答性能。最佳配置为密集检索结合查询改写与重排序,准确率达60.49%。领域专用语言模型比通用模型更有效利用检索到的医学证据。分析还揭示检索有效性与计算成本之间存在明显权衡,简单密集检索配置在保持高吞吐量的同时表现良好。所有实验均在单张消费级GPU上完成,证明系统性评估可于低资源环境下实现。

原文摘要 · Abstract (English)

Large language models (LLMs) have demonstrated strong capabilities in medical question answering; however, purely parametric models often suffer from knowledge gaps and limited factual grounding. Retrieval-augmented generation (RAG) addresses this limitation by integrating external knowledge retrieval into the reasoning process. Despite increasing interest in RAG-based medical systems, the impact of individual retrieval components on performance remains insufficiently understood. This study presents a systematic evaluation of retrieval-augmented medical question answering using the MedQA USMLE benchmark and a structured textbook-based knowledge corpus. We analyze the interaction between language models, embedding models, retrieval strategies, query reformulation, and cross-encoder reranking within a unified experimental framework comprising forty configurations. Results show that retrieval augmentation significantly improves zero-shot medical question answering performance. The best-performing configuration was dense retrieval with query reformulation and reranking achieved 60.49% accuracy. Domain-specialized language models were also found to better utilize retrieved medical evidence than general-purpose models. The analysis further reveals a clear tradeoff between retrieval effectiveness and computational cost, with simpler dense retrieval configurations providing strong performance while maintaining higher throughput. All experiments were conducted on a single consumer-grade GPU, demonstrating that systematic evaluation of retrieval-augmented medical QA systems can be performed under modest computational resources.

医疗问答检索增强RAG零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。