arXiv:2606.19183cs.CLcs.AI2026-06

用大模型读病历,小模型做诊断,提升儿科阑尾炎判断准确率。

Language Models as Interfaces, Not Oracles: A Hybrid LLM-ML System for Pediatric Appendicitis

论文配图:Language Models as Interfaces, Not Oracles: A Hybrid LLM-ML System for Pediatric Appendicitis
图 1 · 摘自论文原文
  • 大模型提取病历关键信息,小模型基于结构化数据预测风险。
  • 在两个德国儿童医院数据集上表现最佳,漏诊率最低。
  • 适合临床决策支持系统开发,注重安全与可解释性。

大型语言模型(LLMs)能通过解析自由文本病历提升临床决策支持的可及性,但其直接作为诊断引擎存在对提示词敏感、信息顺序依赖及生成看似合理实则错误结果的问题。结构化机器学习模型虽有更稳定的预测性能,却需表格输入,难以融入叙述性临床流程。我们提出 ClaMPAPP(儿科阑尾炎临床语言辅助机器学习流程),一种混合系统:将大模型用作接口而非最终决策者,从类似病历的文本中提取符合模式的临床特征,进行确定性合理性校验后,将验证后的特征输入基于临床、实验室和超声变量训练的 XGBoost 分类器。我们在两个独立的德国儿童阑尾炎队列上评估了 ClaMPAPP,对比了端到端大模型基线(包括开源与专有模型)。为保留真实标签并测试自由文本输入,病历文本通过模板渲染和受限大模型重写生成,并额外进行句子顺序打乱以评估位置鲁棒性。ClaMPAPP 在内部与外部验证中均取得最强诊断性能,同时最小化漏诊率,这是急性分诊中的关键安全问题。端到端大模型表现出不稳定的敏感性-特异性权衡,且在文本重排下性能下降更明显。结果支持‘大模型作接口,小模型作预测’的设计范式,实现了自然语言易用性与预测推断的分离,为临床决策支持提供更可审计的路径。

原文摘要 · Abstract (English)

Large language models (LLMs) can make clinical decision support more accessible by interpreting free-text documentation, but their direct use as diagnostic engines is limited by sensitivity to prompts, information order, and plausible but incorrect outputs. Structured machine-learning models offer more stable risk prediction, yet they require tabular inputs that are difficult to integrate with narrative clinical workflows. We present ClaMPAPP (Clinical Language-assisted Machine-learning Pipeline for Appendicitis), a hybrid system that uses an LLM as an interface rather than as the final decision-maker. ClaMPAPP extracts schema-constrained clinical features from note-like narratives, applies deterministic plausibility checks, and passes validated features to an XGBoost classifier trained on clinical, laboratory, and ultrasound variables. We evaluated ClaMPAPP on two independent pediatric appendicitis cohorts from German hospitals and compared it with end-to-end LLM baselines, including open-source and proprietary models. To preserve ground truth while testing free-text input, narratives were generated from structured electronic health records through template rendering and constrained LLM rewriting, with additional sentence-order permutation to assess positional robustness. ClaMPAPP achieved the strongest overall diagnostic performance in both internal and external validation while minimizing missed appendicitis cases, the key safety concern in acute triage. End-to-end LLMs showed unstable sensitivity-specificity trade-offs and greater degradation under narrative reordering. These results support an LLM-as-interface, ML-as-predictor design that separates natural-language usability from predictive inference and provides a more auditable pathway for clinical decision support.

临床决策大模型应用儿科医疗混合系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。