用大模型自动把临床指南转成可执行的智能推荐系统
Automatic Conversion of NICE Guidelines to an Executable Computational Model Using Large Language Models
- 用大模型分步转换指南文本,生成可人工检查的中间结果
- 胰腺癌模型在20个病例上达82.5%的F1分数
- 适合医疗AI开发者和临床决策研究者参考
NICE指南提供循证临床建议,但多为非结构化自然语言。现有转化方法通常针对单一疾病,需大量人工编码且难以扩展。大语言模型(LLMs)有望实现自动化。本文提出端到端方法,将文本指南转化为可执行模型,生成可解释的个性化推荐。通过上下文示例驱动的分步式LLM转换,生成人类可审查的中间产物。应用于胰腺癌和肺癌的NICE指南,经专家评审评估规则一致性,并在20个患者案例上测试胰腺癌模型的可执行性。专家评审显示源指南与生成模型高度对齐,主要差异为部分遗漏而非逻辑错误,幻觉或根本性错误极少。在患者案例中,模型取得82.5%的F1分数。结论表明,LLMs可将自然语言的NICE指南转化为可解释、可执行的模型,保留指南结构,支持透明审查与修改,并生成个体化建议。该研究证明了可扩展自动化生成计算型临床指南的可行性。
原文摘要 · Abstract (English)
Introduction: NICE guidelines provide evidence-based recommendations for clinical care but remain largely in unstructured natural language. Existing approaches to converting them into computable representations often focus on individual diseases, require substantial manual encoding, and do not scale. Large language models (LLMs) may enable much of this translation to be automated. Methods: We present an end-to-end approach that converts textual clinical guidelines into executable models capable of generating explainable, patient-specific recommendations. A stepwise LLM-based transformation with in-context examples produces human-inspectable intermediate artifacts. We apply the approach to NICE pancreatic and lung cancer guidelines, use expert review to assess rule alignment, and evaluate the executable pancreatic cancer model on 20 patient vignettes. Results: Expert review showed strong alignment between the source guidelines and generated executable models. Most discrepancies were partial omissions rather than incorrect logic, while hallucinated or fundamentally incorrect rules were rare. On the patient vignettes, the executable model achieved an F1 score of 82.5%. Conclusion: LLMs can transform natural-language NICE guidelines into interpretable, executable models that preserve guideline structure, support transparent inspection and modification, and generate patient-specific recommendations. These findings demonstrate the feasibility of scalable automated generation of computable clinical guidelines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。