arXiv:2602.16709cs.LGmath.ST2026-02被引 1

用医学语义信息增强低维表示学习,提升小样本医疗数据建模效果。

Knowledge-Embedded Latent Projection for Robust Representation Learning

  • 通过核空间映射将临床概念语义嵌入融入列向量表示
  • 在真实EHR数据上显著降低表示误差,小样本下性能更优
  • 适合医疗数据分析、低样本高维建模场景

潜在空间模型广泛用于分析高维离散数据矩阵,如电子健康记录(EHR)中的患者-特征矩阵,通过低维嵌入捕捉复杂依赖结构。然而,在维度不平衡情况下(一维远大于另一维)估计变得困难:疾病队列规模受限于发病率或数据可得性,而特征空间因医疗编码系统庞大而极其高维。随着外部语义嵌入(如预训练的临床概念嵌入)日益可用,我们提出一种知识嵌入的潜在投影模型,利用语义侧信息正则化表示学习。具体地,通过再生核希尔伯特空间中的映射,将列嵌入建模为语义嵌入的光滑函数。我们设计了一种计算高效的两步估计方法,结合核主成分分析进行语义引导的子空间构造与可扩展的投影梯度下降。我们建立了估计误差界,刻画了由核投影引入的统计误差与近似误差之间的权衡。此外,我们为非凸优化过程提供了局部收敛保证。大量模拟研究和真实EHR应用证明了该方法的有效性。

原文摘要 · Abstract (English)

Latent space models are widely used for analyzing high-dimensional discrete data matrices, such as patient-feature matrices in electronic health records (EHRs), by capturing complex dependence structures through low-dimensional embeddings. However, estimation becomes challenging in the imbalanced regime, where one matrix dimension is much larger than the other. In EHR applications, cohort sizes are often limited by disease prevalence or data availability, whereas the feature space remains extremely large due to the breadth of medical coding system. Motivated by the increasing availability of external semantic embeddings, such as pre-trained embeddings of clinical concepts in EHRs, we propose a knowledge-embedded latent projection model that leverages semantic side information to regularize representation learning. Specifically, we model column embeddings as smooth functions of semantic embeddings via a mapping in a reproducing kernel Hilbert space. We develop a computationally efficient two-step estimation procedure that combines semantically guided subspace construction via kernel principal component analysis with scalable projected gradient descent. We establish estimation error bounds that characterize the trade-off between statistical error and approximation error induced by the kernel projection. Furthermore, we provide local convergence guarantees for our non-convex optimization procedure. Extensive simulation studies and a real-world EHR application demonstrate the effectiveness of the proposed method.

表示学习医疗数据低维嵌入

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。