arXiv:2512.03838cs.CL2025-12被引 3

让大模型按医学指南一步步推理,提升医疗预测的可信度。

Training and Evaluation of Guideline-Based Medical Reasoning in LLMs

  • 用医学指南的规则实例微调大模型,实现逐步推理
  • 小模型微调后推导正确率接近完美,优于大模型零样本学习
  • 适合需可解释医疗推理的临床研究与系统开发

医学早期预测的机器学习近年取得突破性进展,但过度关注预测准确率,忽视了医生所需的真实可解释性。本文旨在教会大模型在推理和预测中严格遵循医学共识指南。由于共识指南广泛存在,将口头化医学推理规则映射到电子健康记录,可为大模型微调提供多领域数据,学习共识规则及例外情况。共识规则还支持自动评估模型推理过程:推导正确性(从前提合理推出结论)和价值正确性(预测值与真实测量值对比)。以复杂的脓毒症3定义为例,实验表明,小规模微调模型在未见患者数据上的推导正确率接近完美,优于使用大模型零样本提示或仅在医学文本上训练的模型。推导正确性瓶颈并非分布外泛化,而是未来变量稀疏不规则采样下的时序预测问题。通过将时间序列预测模型输出与大模型融合,多模态架构可有效改善该问题。

原文摘要 · Abstract (English)

Machine learning for early prediction in medicine has recently shown breakthrough performance, however, the focus on improving prediction accuracy has led to a neglect of faithful explanations that are required to gain the trust of medical practitioners. The goal of this paper is to teach LLMs to follow medical consensus guidelines step-by-step in their reasoning and prediction process. Since consensus guidelines are ubiquitous in medicine, instantiations of verbalized medical inference rules to electronic health records provide data for fine-tuning LLMs to learn consensus rules and possible exceptions thereof for many medical areas. Consensus rules also enable an automatic evaluation of the model's inference process regarding its derivation correctness (evaluating correct and faithful deduction of a conclusion from given premises) and value correctness (comparing predicted values against real-world measurements). We exemplify our work using the complex Sepsis-3 consensus definition. Our experiments show that small fine-tuned models outperform one-shot learning of considerably larger LLMs that are prompted with the explicit definition and models that are trained on medical texts including consensus definitions. Since fine-tuning on verbalized rule instantiations of a specific medical area yields nearly perfect derivation correctness for rules (and exceptions) on unseen patient data in that area, the bottleneck for early prediction is not out-of-distribution generalization, but the orthogonal problem of generalization into the future by forecasting sparsely and irregularly sampled clinical variables. We show that the latter results can be improved by integrating the output representations of a time series forecasting model with the LLM in a multimodal setup.

医学AI可解释推理大模型微调脓毒症预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。