用Transformer统一建模异构电子病历,精准识别临床风险
Deep Learning Approach for Clinical Risk Identification Using Transformer Modeling of Heterogeneous EHR Data
- 用可学习时间编码捕捉不规则采样下的动态变化
- 在多源异构数据上实现准确率、召回率等全面超越
- 适合医疗智能决策系统开发者参考
本研究提出一种基于Transformer的纵向建模方法,应对电子健康记录(EHR)中异构数据带来的挑战,包括不规则的时间模式、大模态差异和复杂语义结构。该方法以多源医疗特征为输入,通过特征嵌入层实现结构化与非结构化数据的统一表示;引入可学习的时间编码机制,捕捉不均匀采样间隔下的动态演化;核心模型采用多头自注意力结构,对纵向序列进行全局依赖建模,实现跨不同时间尺度的长期趋势与短期波动聚合;设计语义加权池化模块,自适应分配关键医疗事件的重要性,提升风险相关特征的区分能力;最后通过线性映射层生成个体风险评分。实验结果表明,所提模型在准确率、召回率、精确率和F1分数上均优于传统机器学习与时序深度学习模型,在多源异构EHR环境中实现稳定精准的风险识别,为临床智能决策提供高效可靠的框架。
原文摘要 · Abstract (English)
This study proposes a Transformer-based longitudinal modeling method to address challenges in clinical risk classification with heterogeneous Electronic Health Record (EHR) data, including irregular temporal patterns, large modality differences, and complex semantic structures. The method takes multi-source medical features as input and employs a feature embedding layer to achieve a unified representation of structured and unstructured data. A learnable temporal encoding mechanism is introduced to capture dynamic evolution under uneven sampling intervals. The core model adopts a multi-head self-attention structure to perform global dependency modeling on longitudinal sequences, enabling the aggregation of long-term trends and short-term fluctuations across different temporal scales. To enhance semantic representation, a semantic-weighted pooling module is designed to assign adaptive importance to key medical events, improving the discriminative ability of risk-related features. Finally, a linear mapping layer generates individual-level risk scores. Experimental results show that the proposed model outperforms traditional machine learning and temporal deep learning models in accuracy, recall, precision, and F1-Score, achieving stable and precise risk identification in multi-source heterogeneous EHR environments and providing an efficient and reliable framework for clinical intelligent decision-making.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。