让大模型像医生一样一步步问诊检查,动态更新诊断。
MedAction: Towards Active Multi-turn Clinical Diagnostic LLMs

- 构建树状推理管道,模拟多轮问诊与检验过程
- 在32,681条真实病例轨迹上训练,诊断准确率领先开源模型
- 专为临床多轮互动设计,适合医疗AI研发者参考
现有医疗大模型多在静态、单轮场景下评估,无法反映真实诊疗中逐步获取信息的过程。本文研究主动诊断:从初始观察出发,通过检测、解读结果、持续更新鉴别诊断的多轮交互流程。系统分析发现当前模型存在三项缺陷:无依据的检测建议、不可靠的诊断更新、多轮推理连贯性下降。根源在于训练数据仅覆盖完整信息下的推理,缺乏对动态、不完全证据下决策的训练。为此提出MedAction,一种基于树结构的蒸馏流程,通过大模型与环境交互生成多样高质量的多轮诊断轨迹。设计两个知识图谱引导的评估指标:疾病轨迹一致性(DTC)衡量假设是否收敛至正确诊断;推理-行动一致性(RAC)验证信念更新是否由实际证据驱动。基于该流程构建了包含32,681条轨迹的MedAction-32K数据集,涵盖2,896个PMC病例。在该数据集上微调8B模型后,在MedR-Bench和自建的MedAction-300-Hard基准上均达到开源模型最佳表现,推动了开源医疗大模型的边界。
原文摘要 · Abstract (English)
Most existing LLM diagnoses are evaluated on static, single-turn settings where complete patient information is provided upfront, an oversimplification of real clinical practice. We study active diagnosis: the real-life clinical process of starting from initial observation, ordering tests, interpreting results, and updating a differential diagnosis across multiple turns. Through systematic analysis, we identify three recurring failure modes in current LLMs: ungrounded test ordering, unreliable diagnostic update, and degraded multi-turn coherence. Together, these failures reveal a core deficit: existing medical training data teaches models to reason from complete information but not to act under evolving, partial evidence. To address this gap, we introduce MedAction, a tree-structured distillation pipeline that synthesizes diverse and high-quality multi-turn diagnostic trajectories via LLM-environment interaction. We propose two knowledge-graph-grounded metrics to filter trajectory quality: Disease Trajectory Consistency (DTC), which tracks whether the model's hypothesis converges toward the correct diagnosis, and Reasoning-Action Consistency (RAC), which verifies that belief updates are driven by gathered evidence. Using this pipeline, we construct MedAction-32K, a dataset of 32,681 trajectories from 2,896 PMC cases. Fine-tuning an 8B model on MedAction-32K achieves state-of-the-art performance among open-source models on both MedR-Bench and our curated MedAction-300-Hard benchmark, pushing the edge for open-source medical LLMs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。