arXiv:2507.18583cs.IRcs.AI2025-07中稿 · ance被引 1

针对病历检索的语义鸿沟问题,提出融合医学知识与合成数据的高效检索模型。

DR.EHR: Dense Retrieval for Electronic Health Record with Knowledge Injection and Synthetic Data

  • 分两阶段训练:先注入生物医学知识图谱,再用大模型生成多样化训练数据
  • 在CliniQ上超越现有模型,7B参数版本达最新性能,尤其擅长缩写和隐含匹配
  • 适合临床问答、复杂实体查询等实际医疗场景,兼具准确性和泛化能力

电子健康记录(EHR)在临床实践中至关重要,但其检索仍面临语义鸿沟挑战。现有密集检索模型,无论通用领域还是生物医学领域,均因医学知识不足或训练语料不匹配而表现不佳。本文提出 exttt{DR.EHR},一系列专为EHR检索设计的密集检索模型。采用MIMIC-IV出院摘要构建两阶段训练流程:第一阶段从生物医学知识图谱中提取医疗实体并注入模型;第二阶段利用大语言模型生成多样化的训练数据。训练了两个变体,参数量分别为110M和7B。在CliniQ基准测试中,所提模型显著优于所有现有密集检索器,达到最先进水平。详细分析表明,模型在各类匹配类型中表现优异,尤其在含义推断和缩写识别等难题上优势明显。消融实验验证各组件有效性,补充实验在EHR问答数据集上展示模型对自然语言问题(包括多实体复杂问题)的强泛化能力。该工作显著推进了EHR检索技术,为临床应用提供可靠解决方案。

原文摘要 · Abstract (English)

Electronic Health Records (EHRs) are pivotal in clinical practices, yet their retrieval remains a challenge mainly due to semantic gap issues. Recent advancements in dense retrieval offer promising solutions but existing models, both general-domain and biomedical-domain, fall short due to insufficient medical knowledge or mismatched training corpora. This paper introduces \texttt{DR.EHR}, a series of dense retrieval models specifically tailored for EHR retrieval. We propose a two-stage training pipeline utilizing MIMIC-IV discharge summaries to address the need for extensive medical knowledge and large-scale training data. The first stage involves medical entity extraction and knowledge injection from a biomedical knowledge graph, while the second stage employs large language models to generate diverse training data. We train two variants of \texttt{DR.EHR}, with 110M and 7B parameters, respectively. Evaluated on the CliniQ benchmark, our models significantly outperforms all existing dense retrievers, achieving state-of-the-art results. Detailed analyses confirm our models' superiority across various match and query types, particularly in challenging semantic matches like implication and abbreviation. Ablation studies validate the effectiveness of each pipeline component, and supplementary experiments on EHR QA datasets demonstrate the models' generalizability on natural language questions, including complex ones with multiple entities. This work significantly advances EHR retrieval, offering a robust solution for clinical applications.

EHR检索知识注入合成数据大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。