arXiv:2412.11671cs.CLcs.AI2024-12中稿 · IEEE Access 2024被引 1

用跨语言混合病历训练统一医学嵌入,提升儿科急诊决策效率

BioBridge: Unified Bio-Embedding with Bridging Modality in Code-Switched EMR

  • 构建上下文桥接模块,理解中英混杂的病历文本
  • 注入医学知识到编码器,缩小通用与医学领域的差距
  • 在韩语病历上显著提升准确率与预测可靠性,适合医疗AI研究者

儿童急诊科拥堵是全球性难题,亟需高效解决方案。本文提出BioBridge框架,利用自然语言处理技术分析以自由文本形式存在的电子病历(EMR),提升儿科急诊决策能力。在非英语国家如韩国,病历常采用中英混杂的代码切换(Code-Switching, CS)格式,其中多数英文词汇具有临床意义。BioBridge包含两个核心模块:'上下文中的跨模态桥接'和'统一医学嵌入'。前者增强对双语及代码切换病历的上下文理解;后者将医学领域预训练模型的知识注入编码器,弥合医学与通用领域间的鸿沟。实验表明,BioBridge在多个指标上显著优于传统机器学习与预训练编码器模型,包括F1分数、受试者工作特征曲线下面积(AUROC)、精确率-召回率曲线下面积(AUPRC)和Brier评分。具体而言,BioBridge-XLM在F1分数上提升0.85%,AUROC提升0.75%,AUPRC提升0.76%,同时Brier评分降低3.04%,显示出在准确性、可靠性和预测校准方面的显著改进。源代码将公开可用。

原文摘要 · Abstract (English)

Pediatric Emergency Department (PED) overcrowding presents a significant global challenge, prompting the need for efficient solutions. This paper introduces the BioBridge framework, a novel approach that applies Natural Language Processing (NLP) to Electronic Medical Records (EMRs) in written free-text form to enhance decision-making in PED. In non-English speaking countries, such as South Korea, EMR data is often written in a Code-Switching (CS) format that mixes the native language with English, with most code-switched English words having clinical significance. The BioBridge framework consists of two core modules: "bridging modality in context" and "unified bio-embedding." The "bridging modality in context" module improves the contextual understanding of bilingual and code-switched EMRs. In the "unified bio-embedding" module, the knowledge of the model trained in the medical domain is injected into the encoder-based model to bridge the gap between the medical and general domains. Experimental results demonstrate that the proposed BioBridge significantly performance traditional machine learning and pre-trained encoder-based models on several metrics, including F1 score, area under the receiver operating characteristic curve (AUROC), area under the precision-recall curve (AUPRC), and Brier score. Specifically, BioBridge-XLM achieved enhancements of 0.85% in F1 score, 0.75% in AUROC, and 0.76% in AUPRC, along with a notable 3.04% decrease in the Brier score, demonstrating marked improvements in accuracy, reliability, and prediction calibration over the baseline XLM model. The source code will be made publicly available.

医学NLP代码切换多语言嵌入

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。