arXiv:2608.01012cs.CLcs.AI2026-08

让大模型学会看病中间步骤,提升罕见病诊断辅助能力。

MedUPS: Towards Diagnostic Assistance in Uncommon Medical Cases with Large Language Models

论文配图:MedUPS: Towards Diagnostic Assistance in Uncommon Medical Cases with Large Language Models
图 1 · 摘自论文原文
  • 将病例拆成逐步积累的临床片段,用强化学习训练模型预测下一步行动。
  • 在三个模型上,中段决策准确率从55%提升至67%,小模型表现优于大模型。
  • 适合做临床决策支持、医疗AI评估与医患沟通系统研发者参考。

罕见且偏离指南的病例对临床决策支持构成挑战,因医生需在诊断不确定下做出一系列管理决策,且难以一次性掌握完整病历。现有医学大模型基准多仅评估最终诊断,但临床实际更依赖下一步行动:如该做哪项检查、影像学研究或转诊专科。本文构建了包含21,874个中段临床决策点的MedUPSQA数据集,基于5,535份真实病例报告;提出MedUPS对齐框架,通过强化学习(GRPO)监督模型在患者诊疗轨迹中逐步预测下一步操作,并使用外部大模型作为裁判生成奖励信号。该目标模拟临床医生循证推理过程,而非直接锁定最终诊断。在三种模型上,中段对齐使下一步预测准确率分别从55.2%提升至66.7%(Qwen3.6-27B)、47.2%至57.8%(Qwen3.5-9B)、37.8%至44.4%(HuatuoGPT-3-8B),置信区间95%。在多个模型规模中,该目标带来的性能提升超过模型规模增长,小模型甚至超越大型前沿模型。进一步的监督微调(SFT)基线也验证了该任务具有独立可学习信号。论文发布数据集、代码与对齐模型检查点。

原文摘要 · Abstract (English)

Uncommon and off-guideline cases are difficult for clinical decision support, because physicians must make a series of management decisions under diagnostic uncertainty and rarely see the full case at once. Most large language model (LLM) benchmarks for medicine score only the final diagnosis, yet much of clinical care turns on the next appropriate action: the next test to order, the imaging study to obtain, the specialist to involve, or the differential to pursue. We introduce MedUPSQA, a dataset of 21,874 mid-stream clinical decision points built from 5,535 real case reports, and MedUPS, an alignment framework that supervises models on these intermediate decisions as they unfold along a patient's trajectory. We segment free-text case presentations into chronologically ordered, accumulating clinical chunks and align models to predict the next step with reinforcement learning (GRPO), using an external LLM-as-a-Judge reward. This objective mirrors how clinicians actually meet patients, reasoning forward from accumulating evidence toward the next decision, rather than committing to a final label. Across three backbones, mid-stream alignment raises next-step accuracy from 55.2 to 66.7 for Qwen3.6-27B, from 47.2 to 57.8 for Qwen3.5-9B, and from 37.8 to 44.4 for HuatuoGPT-3-8B, with 95% CI. In several model scales we test the objective improves accuracy more than scale, with smaller models surpassing larger, frontier models we evaluate. We further train supervised fine-tuning (SFT) baselines on the mid-stream task, SFT improves all backbones above base, indicating the target framwork carries signal independently of the optimizer. We release the dataset, code, and aligned checkpoints.

医疗AI大模型临床决策强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。