arXiv:2608.21941cs.AI2026-08

用提示学习应对重症监护中多模态数据缺失,提升预测鲁棒性。

Multimodal Prompt Learning with Irregular EHRs for Robust Monitoring of Critical Care Patients

论文配图:Multimodal Prompt Learning with Irregular EHRs for Robust Monitoring of Critical Care Patients
图 1 · 摘自论文原文
  • 设计四类提示:生成、缺失信号、缺失类型和时间提示,协同建模缺失模式。
  • 在两种缺失场景下,性能优于现有方法,关键指标提升显著。
  • 适合处理真实临床中不完整多模态病历的医疗AI研究者使用。

重症监护患者精准评估对及时临床干预和改善预后至关重要。多模态电子健康记录(EHR)包含结构化生理时序数据和纵向临床文本,可互补用于危重症预测。然而,现实临床中各模态常部分或完全缺失,导致现有多模态模型性能大幅下降。为此,我们提出一种鲁棒的多模态提示学习框架,应对多样缺失场景。该框架引入四类互补提示:生成提示构建缺失模态的替代潜在表示,缺失信号提示区分真实与生成表示,缺失类型提示根据模态可用性配置条件化模型,时间提示对时序编码序列进行条件聚合。四类提示共同实现缺失感知的模态内依赖与跨模态交互建模。大量实验表明,本方法在两种缺失设置下均优于现有方法。消融与鲁棒性分析验证了四类提示的互补贡献及框架对不完整多模态EHR数据临床预测的有效性。

原文摘要 · Abstract (English)

Accurate assessment of patients in intensive care units (ICUs) is essential for timely clinical intervention and improved patient outcomes. Multimodal electronic health records (EHRs), including structured physiological time series and longitudinal clinical notes, provide complementary information for critical care prediction. However, in real-world clinical settings, individual modalities may be partially observed or entirely unavailable, resulting in substantial performance degradation for existing multimodal models. To address this challenge, we propose a multimodal prompt-learning framework for robust clinical prediction under diverse missing-modality scenarios. The proposed framework introduces four complementary types of prompts: generative prompts, missing-signal prompts, missing-type prompts, and temporal prompts. Generative prompts construct surrogate latent representations for unavailable modalities, while missing-signal prompts distinguish observed representations from generated ones. Missing-type prompts condition the model on different modality-availability configurations, whereas temporal prompts perform condition-specific aggregation over temporally encoded clinical sequences. Together, these prompts enable the model to capture missingness-aware intramodal dependencies and cross-modal interactions within a unified architecture. Extensive experiments demonstrate that our method outperforms existing approaches across evaluation metrics on two missingness settings. Ablation and robustness analyses further verify the complementary contributions of the four prompt types and the effectiveness of the proposed framework for clinical prediction from incomplete multimodal EHR data.

多模态学习临床预测缺失数据提示学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。