arXiv:2603.20921cs.LG2026-03被引 2

直接对齐临床结果,让模型学得更精准。

Discriminative Representation Learning for Clinical Prediction

  • 用临床结果直接引导表示学习,优化特征分布。
  • 在死亡率和再入院预测上优于多种自监督方法。
  • 适合有高质量标注数据的医疗预测场景。

医疗领域的基础模型大多沿用自然语言处理与计算机视觉中的自监督预训练目标,强调重建任务和大规模表征学习。本文在以结局为导向的临床预测场景中重新审视这一范式,认为当具备高质量监督信号时,直接对齐临床结果可提供比生成式预训练更强的归纳偏置。我们提出一种监督深度学习框架,通过最大化类间分离度与类内方差之比,显式塑造表示几何结构,使模型容量集中于临床有意义的方向。在多个纵向电子健康记录任务(包括死亡率与再入院预测)中,该方法在相同模型容量下持续优于掩码、自回归及对比学习等基线方法。所提方法显著提升判别能力、校准性与样本效率,并将训练流程简化为单阶段优化。研究结果表明,在低熵、以结局驱动的医疗领域,监督信号可作为统计最优的表示学习驱动力,挑战了大规模自监督预训练是强临床性能前提的假设。

原文摘要 · Abstract (English)

Foundation models in healthcare have largely adopted self supervised pretraining objectives inherited from natural language processing and computer vision, emphasizing reconstruction and large scale representation learning prior to downstream adaptation. We revisit this paradigm in outcome centric clinical prediction settings and argue that, when high quality supervision is available, direct outcome alignment may provide a stronger inductive bias than generative pretraining. We propose a supervised deep learning framework that explicitly shapes representation geometry by maximizing inter class separation relative to within class variance, thereby concentrating model capacity along clinically meaningful axes. Across multiple longitudinal electronic health record tasks, including mortality and readmission prediction, our approach consistently outperforms masked, autoregressive, and contrastive pretraining baselines under matched model capacity. The proposed method improves discrimination, calibration, and sample efficiency, while simplifying the training pipeline to a single stage optimization. These findings suggest that in low entropy, outcome driven healthcare domains, supervision can act as the statistically optimal driver of representation learning, challenging the assumption that large scale self supervised pretraining is a prerequisite for strong clinical performance.

临床预测监督学习表示学习电子病历

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。