解决临床数据缺失不随机问题,提升多模态患者表征学习效果
Causal Representation Learning from Multimodal Clinical Records under Non-Random Modality Missingness
- 基于缺失模式设计因果融合机制,捕捉医生决策影响
- 在MIMIC-IV和eICU上实现最高13.8%的读住院预测AUC提升
- 适合处理真实医疗数据中非随机缺失场景的研究者
临床记录包含丰富患者信息,如诊断或用药,对患者表征学习至关重要。尽管大语言模型提升了文本信息提取能力,但临床记录常存在缺失——例如在MIMIC-IV数据集中,24.5%的患者无可用出院小结。此时可依赖结构化数据、胸部X光片或放射科报告等其他模态。然而这些模态的可用性受临床决策影响,呈现非随机缺失(MMNAR)特征。本文提出一种因果表示学习框架,利用观测数据与信息性缺失模式,在多模态临床记录中学习更鲁棒的患者表征。该框架包含:(1) 考虑缺失模式的模态融合模块,结合结构化数据、影像与文本;(2) 基于对比学习的模态重建模块,保障表征语义完备性;(3) 多任务结果预测模型,通过修正器消除特定模态观测模式带来的残余偏差。在MIMIC-IV与eICU数据集上的综合评估显示,相比最强基线,该方法在住院再入院预测中最高提升13.8% AUC,ICU入院预测提升13.1%。
原文摘要 · Abstract (English)
Clinical notes contain rich patient information, such as diagnoses or medications, making them valuable for patient representation learning. Recent advances in large language models have further improved the ability to extract meaningful representations from clinical texts. However, clinical notes are often missing. For example, in our analysis of the MIMIC-IV dataset, 24.5% of patients have no available discharge summaries. In such cases, representations can be learned from other modalities such as structured data, chest X-rays, or radiology reports. Yet the availability of these modalities is influenced by clinical decision-making and varies across patients, resulting in modality missing-not-at-random (MMNAR) patterns. We propose a causal representation learning framework that leverages observed data and informative missingness in multimodal clinical records. It consists of: (1) an MMNAR-aware modality fusion component that integrates structured data, imaging, and text while conditioning on missingness patterns to capture patient health and clinician-driven assignment; (2) a modality reconstruction component with contrastive learning to ensure semantic sufficiency in representation learning; and (3) a multitask outcome prediction model with a rectifier that corrects for residual bias from specific modality observation patterns. Comprehensive evaluations across MIMIC-IV and eICU show consistent gains over the strongest baselines, achieving up to 13.8% AUC improvement for hospital readmission and 13.1% for ICU admission.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。