arXiv:2410.12860cs.CLcs.AI2024-10被引 6

LLMD通过分析多年多院病历,精准理解患者医疗历程。

LLMD: A Large Language Model for Interpreting Longitudinal Medical Records

  • 用数百万份跨机构长期病历预训练,融合领域知识与时间序列数据
  • 在医学问答和用药时段建模任务中超越大模型,8B版本达SOTA
  • 适合真实临床场景,尤其强调时间跨度与多源数据整合

我们提出LLMD,一种专为解析患者纵向医疗记录设计的大语言模型。该模型基于跨机构、平均长达10年的病历数据(最多覆盖140个医疗机构)及包含细微关联的任务标签进行训练。先在海量记录与领域知识上继续预训练,再通过结构化与抽象化指令微调,实现文档元数据、临床实体与时间期段的统一表征。部署中采用分层验证系统,结合随机审计与专家评审。实验表明,LLMD-8B在PubMedQA等基准上优于参数量大得多的通用模型;在实际任务中,其表现显著超越所有对比模型,且通用大模型如GPT-4o比专注医学知识的模型更优。研究发现,当前医学基准测试准确率并非真实病历分析的关键指标,这对未来医疗大模型设计具有重要启示。

原文摘要 · Abstract (English)

We introduce LLMD, a large language model designed to analyze a patient's medical history based on their medical records. Along with domain knowledge, LLMD is trained on a large corpus of records collected over time and across facilities, as well as tasks and labels that make nuanced connections among them. This approach is critical to an accurate picture of patient health, and has distinctive advantages over models trained on knowledge alone, unlabeled records, structured EHR data, or records from a single health system. The recipe for LLMD continues pretraining a foundational model on both domain knowledge and the contents of millions of records. These span an average of 10 years of care and as many as 140 care sites per patient. LLMD is then instruction fine-tuned on structuring and abstraction tasks. The former jointly identify and normalize document metadata, provenance information, clinical named-entities, and ontology mappings, while the latter roll these into higher-level representations, such a continuous era of time a patient was on a medication. LLMD is deployed within a layered validation system that includes continual random audits and review by experts, e.g. based on uncertainty, disease-specific rules, or use-case. LLMD exhibits large gains over both more-powerful generalized models and domain-specific models. On medical knowledge benchmarks, LLMD-8B achieves state of the art accuracy on PubMedQA text responses, besting orders-of-magnitude larger models. On production tasks, we show that LLMD significantly outperforms all other models evaluated, and among alternatives, large general purpose LLMs like GPT-4o are more accurate than models emphasizing medical knowledge. We find strong evidence that accuracy on today's medical benchmarks is not the most significant factor when analyzing real-world patient data, an insight with implications for future medical LLMs.'

医疗大模型纵向病历时间序列可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。