arXiv:2607.20453cs.CLcs.AI2026-07

用外部医学知识增强语言模型,提升重症谵妄预测能力。

A Knowledge-Injection Framework for Zero-Shot Adaptation of LLMs to Delirium Prediction

论文配图:A Knowledge-Injection Framework for Zero-Shot Adaptation of LLMs to Delirium Prediction
图 1 · 摘自论文原文
  • 推理时注入临床知识报告,无需微调或检索。
  • 8B模型性能提升8.57个百分点,70B模型提升1.99个百分点。
  • 适合资源有限的医疗机构,兼顾隐私与实用性。

大型语言模型在临床预测中展现潜力,但零样本表现受限于领域知识不完整,尤其对小型本地部署模型而言。本文提出一种轻量级知识注入框架,用于零样本重症监护谵妄预测:在推理时将结构化电子病历的自然语言摘要,与外部临床知识报告相结合,无需微调或检索。我们在MIMIC IV数据集的3,160例重症监护入院记录上评估了LLaMA 3.1 8B和LLaMA 3.3 70B模型。加入具有临床意义的外部知识报告后,8B模型的AUROC提升8.57个百分点,70B模型提升1.99个百分点。相较于无外部知识的GPT-5.2基准(AUROC 68.86%),知识注入使LLaMA 8B的性能差距从15.66降至7.09 AUROC点,LLaMA 70B从5.30降至3.31 AUROC点。随机控制报告不提升性能,甚至降低表现,说明收益依赖于临床内容而非提示长度。基于SHAP的归因分析进一步证实注入知识被实际用于预测。结果表明,推理时知识注入可在不牺牲隐私的前提下,缩小本地可部署开源模型与前沿闭源模型之间的性能差距。

原文摘要 · Abstract (English)

Large language models show promise for clinical prediction, but zero-shot performance on specialized tasks is limited by incomplete domain knowledge, especially for smaller locally deployable models. We present a lightweight knowledge-injection framework for zero-shot ICU delirium prediction that augments a deterministic natural-language summary of structured electronic health record data with an external clinical knowledge report at inference time, without fine-tuning or retrieval. We evaluate LLaMA 3.1 8B and LLaMA 3.3 70B on 3,160 ICU admissions from the MIMIC IV dataset. Adding a clinically meaningful external knowledge report improves AUROC by 8.57 percentage points for the 8B model and 1.99 percentage points for the 70B model compared to no external knowledge. Relative to a GPT-5.2 frontier-model reference without external knowledge report (AUROC 68.86%), knowledge injection reduces the performance gap from 15.66 to 7.09 AUROC points for LLaMA 8B and from 5.30 to 3.31 AUROC points for LLaMA 70B. Random control reports do not improve performance and often degrade it, indicating that gains depend on clinically meaningful content rather than added prompt length alone. SHAP-based attribution further confirms that the injected knowledge is actively used during prediction. These findings suggest that inference-time knowledge injection can narrow the gap between locally deployable open-weight models and frontier closed models while preserving a practical, privacy-preserving workflow for resource-constrained clinical settings.

大模型医疗预测知识注入零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。