让AI看病时像医生一样思考,精准检索所需医学知识。
RAR$^2$: Retrieval-Augmented Medical Reasoning via Thought-Driven Retrieval
- 通过构建思考过程揭示隐含的医学知识需求,指导检索与推理。
- 在多个生物医学问答数据集上超越现有RAG方法,提升答案准确性。
- 适合医疗AI研发者、临床辅助系统设计者使用。
大型语言模型(LLMs)在多种医学基准测试中表现出色,展现出支持实际临床任务的潜力。检索增强生成(RAG)已成为缓解知识盲区和幻觉问题的关键方法,通过引入外部医学信息来提升表现。然而,面对需要深度推理的复杂医学问题,传统RAG因仅依赖表层输入而难以反映真实的知识需求。现有方法通常只优化查询,未显式建模推理过程,限制了对临床相关知识的检索与整合能力。本文提出RAR²,一个联合学习框架,同时改进推理增强检索与检索增强推理。该框架构建思考过程以揭示隐含知识需求,并据此引导检索与答案生成。我们构建了一个混合偏好对训练数据集,并采用直接偏好优化(DPO)进行模型训练。此外,还设计了两种测试时扩展策略以探索框架边界。实验表明,RAR²在多个生物医学问答数据集上均显著优于基线方法,无论是否微调。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have shown promising performance on diverse medical benchmarks, highlighting their potential in supporting real-world clinical tasks. Retrieval-Augmented Generation (RAG) has emerged as a key approach for mitigating knowledge gaps and hallucinations by incorporating external medical information. However, RAG still struggles with complex medical questions that require intensive reasoning, as surface-level input often fails to reflect the true knowledge needs of the task. Existing methods typically focus on refining queries without explicitly modeling the reasoning process, limiting their ability to retrieve and integrate clinically relevant knowledge. In this work, we propose RAR$^2$, a joint learning framework that improves both Reasoning-Augmented Retrieval and Retrieval-Augmented Reasoning. RAR$^2$ constructs a thought process to uncover implicit knowledge requirements and uses it to guide retrieval and answer generation. We build a training dataset of mixed preference pairs and apply Direct Preference Optimization (DPO) to train the model. Moreover, we design two test-time scaling strategies to explore the boundaries of our framework. Experiments demonstrate the effectiveness of RAR$^2$ across several biomedical question answering datasets, outperforming RAG baselines with or without fine-tuning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。