用强化学习训练可追踪诊断推理的智能检索系统,提升医疗诊断准确率。
End-to-End Agentic RAG System Training for Traceable Diagnostic Reasoning
- 构建端到端强化学习框架,让AI像医生一样迭代搜索与推理。
- 在真实病例中将医生诊断准确率从45.6%提升至69.1%,平均超基线22.7%。
- 适用于临床辅助诊断、医学AI研究者及需可信推理的医疗系统开发者。
将大语言模型(LLM)融入医疗面临知识局限、幻觉和与循证医学脱节的问题。尽管检索增强生成(RAG)提供解决方案,但现有系统多依赖静态流程,无法模拟临床医生的迭代式假设演绎推理。为此,我们提出Deep-DxSearch,一种通过强化学习(RL)端到端训练的代理型RAG系统,实现可追踪的诊断推理。Deep-DxSearch作为主动调查者,运行于包含16,000+指南衍生疾病档案、150,000+患者记录及超过2700万生物医学文献的环境。利用软可验证奖励函数,协同优化检索与推理,使模型学会提出查询、评估证据并持续优化搜索以填补诊断空白。实验表明,该端到端RL框架持续优于提示工程与无训练RAG方法。在常见病与罕见病的分布内(ID)与分布外(OOD)基准测试中,其表现超越包括GPT-4o、DeepSeek-R1及医疗专用框架在内的强基线模型,平均准确率提升22.7%。在150个真实病例验证中,将医生平均诊断准确率从45.6%提升至69.1%。结果表明,基于大规模医疗数据统计规律演化代理系统,是构建可信诊断助手的关键。所有数据、代码与检查点详见https://qiaoyu-zheng.github.io/Deep-DxSearch。
原文摘要 · Abstract (English)
The integration of Large Language Models (LLMs) into healthcare is constrained by knowledge limitations, hallucinations, and a disconnect from Evidence-Based Medicine (EBM). While Retrieval-Augmented Generation (RAG) offers a solution, current systems often rely on static workflows that miss the iterative, hypothetico-deductive reasoning of clinicians. To address this, we introduce Deep-DxSearch, an agentic RAG system trained end-to-end via reinforcement learning (RL) for traceable diagnostic reasoning. Deep-DxSearch acts as an active investigator, treating the LLM as an agent within an environment of 16,000+ guideline-derived disease profiles, 150,000+ patient records for case-based reasoning, and over 27 million biomedical documents. Using soft verifiable rewards that co-optimize retrieval and reasoning, the model learns to formulate queries, evaluate evidence, and refine searches to close diagnostic gaps. Experiments show our end-to-end RL framework consistently outperforms prompt-engineering and training-free RAG methods. On in-distribution (ID) and out-of-distribution (OOD) benchmarks for common and rare diseases, Deep-DxSearch surpasses strong baselines-including GPT-4o, DeepSeek-R1, and medical-specific frameworks-achieving an average accuracy gain of 22.7% over the second-best model. In validation with 150 real-world cases, Deep-DxSearch boosts physicians' average diagnostic accuracy from 45.6% to 69.1%. These results indicate that evolving agentic systems to leverage statistical regularities in large-scale healthcare data is key for trustworthy diagnostic assistants. All data, code, and checkpoints are available at https://qiaoyu-zheng.github.io/Deep-DxSearch.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。