arXiv:2602.00541cs.LG2026-02被引 4

提出联合建模事件时间与数值测量的新预训练目标,提升电子病历模型泛化能力。

One Loss to Rule Them All: Marked Time-to-Event for Structured EHR Foundation Models

  • 设计标记型时间到事件的预训练目标,同时捕捉事件发生时间与测量值。
  • 在多个数据集上优于传统方法,显著提升回归和生存预测性能。
  • 适合需要理解病程动态的临床研究者与模型开发者。

电子病历(EHR)中的临床事件采样不规则,包含离散事件与连续数值(如检验值、用药剂量)。现有基础模型多采用下一个词预测进行预训练,但忽略了事件发生时间与测量值对后续事件的联合影响。我们提出 ORA:一种标记型时间到事件的预训练目标,同时建模事件发生时间和伴随测量值。在多个数据集、下游任务和模型架构上,该方法生成的表征更具泛化性,优于仅依赖事件序列或忽略连续值的预训练策略。尤其在回归与时间到事件预测任务中表现突出。消融实验表明,充分考虑 EHR 结构的预训练目标是提升模型下游能力的关键。

原文摘要 · Abstract (English)

Clinical events captured in Electronic Health Records (EHR) are irregularly sampled and may consist of a mixture of discrete events and numerical measurements, such as laboratory values or treatment dosages. The sequential nature of EHR, analogous to natural language, has motivated the use of next-token prediction to train prior EHR Foundation Models (FMs) over events. However, this training fails to capture the full structure of EHR. When a given event occurs must be captured, but the event value (abnormal lab) also modulates the likelihood of other clinical events. Most existing EHR FMs do not jointly model this likelihood and are unable to capture the full observation process, impacting downstream capabilities. We propose ORA, a marked time-to-event pretraining objective that jointly models event timing and associated measurements. Across multiple datasets, downstream tasks, and model backbones, this objective consistently yields more generalizable representations than next-token prediction and pretraining losses that ignore continuous measurements. Importantly, the proposed objective yields improvements beyond traditional classification evaluation, including better regression and time-to-event prediction. Beyond introducing a new family of FMs, our ablations suggest a broader takeaway: pretraining objectives that account for EHR structure are critical for expanding downstream capabilities and generalizability.

电子病历时间建模预训练临床预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。