arXiv:2507.01437cs.CL2025-07被引 12

用注意力模型统一处理病历文本,实现多疾病联合预测。

Clinical NLP with Attention-Based Deep Learning for Multi-Disease Prediction

  • 基于Transformer的自注意力机制捕捉医疗实体与上下文关系。
  • 在MIMIC-IV数据集上多指标优于现有方法,泛化能力强。
  • 适合临床文本分析、多病共现建模等实际医疗场景使用。

本文针对电子健康记录文本的非结构化特性与高维语义复杂性挑战,提出一种基于注意力机制的深度学习方法,实现信息抽取与多标签疾病预测的统一建模。研究基于MIMIC-IV数据集,采用Transformer架构对临床文本进行表示学习,通过多层自注意力机制捕获关键医学实体及其上下文关联,并使用Sigmoid-based多标签分类器预测多个疾病标签。模型引入上下文感知语义对齐机制,在标签共现、信息稀疏等典型医疗场景中增强表征能力。通过基线对比、超参数敏感性分析、数据扰动与噪声注入测试等系列实验,结果表明该方法在多项性能指标上持续优于现有代表性方法,且在不同数据规模、干扰水平与模型深度配置下均保持良好泛化性。本研究构建的框架为真实临床文本处理提供了高效算法基础,具有重要的实践意义。

原文摘要 · Abstract (English)

This paper addresses the challenges posed by the unstructured nature and high-dimensional semantic complexity of electronic health record texts. A deep learning method based on attention mechanisms is proposed to achieve unified modeling for information extraction and multi-label disease prediction. The study is conducted on the MIMIC-IV dataset. A Transformer-based architecture is used to perform representation learning over clinical text. Multi-layer self-attention mechanisms are employed to capture key medical entities and their contextual relationships. A Sigmoid-based multi-label classifier is then applied to predict multiple disease labels. The model incorporates a context-aware semantic alignment mechanism, enhancing its representational capacity in typical medical scenarios such as label co-occurrence and sparse information. To comprehensively evaluate model performance, a series of experiments were conducted, including baseline comparisons, hyperparameter sensitivity analysis, data perturbation studies, and noise injection tests. Results demonstrate that the proposed method consistently outperforms representative existing approaches across multiple performance metrics. The model maintains strong generalization under varying data scales, interference levels, and model depth configurations. The framework developed in this study offers an efficient algorithmic foundation for processing real-world clinical texts and presents practical significance for multi-label medical text modeling tasks.

临床NLP多疾病预测注意力机制Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。