arXiv:2606.24102cs.CLcs.LG2026-06被引 1

PORTER让电子病历模型摆脱固定词汇表,实现跨机构无缝迁移。

PORTER: Language-Grounded Event Representations for Portable Structured EHR Foundation Models

论文配图:PORTER: Language-Grounded Event Representations for Portable Structured EHR Foundation Models
图 1 · 摘自论文原文
  • 用文本编码器+数值路径解耦事件表示,不再依赖固定词汇表。
  • 跨词汇迁移时恢复97.1%的性能,且在MIMIC上表现优于传统模型。
  • 适合需要跨机构部署或快速适配新任务的医疗AI研发者。

大多数电子病历(EHR)基础模型将临床事件编码为固定词汇表中的离散标记,无法直接表示包含未见概念或新组合(如数值)的事件,限制了机构间甚至同一机构内不同部署流程间的迁移能力。我们提出PORTER,一种基于语言的结构化EHR基础模型,将事件表示与固定词汇解耦:通过冻结的文本编码器表示事件描述,专设路径整合数值信息,并使用自回归预训练的时间骨干网络学习患者时间序列上的临床动态。在一家儿童医院的74项临床预测任务中,PORTER在相同时间骨干和预训练目标下,达到与固定词汇模型相当的平均AUROC。当使用预训练阶段未见的事件描述进行渲染时,PORTER无需重训或词汇映射即可迁移,恢复了目标词汇模型97.1%的平均AUROC。迁移到MIMIC数据集时,其表现优于固定词汇模型(后者因86%的事件标记未见而丢弃69%事件)。机制分析表明,跨词汇迁移效果主要依赖患者级表示几何的保留,而非文本编码器规模;数值路径提升对数值大小的敏感性,同时不破坏临床概念身份。此外,PORTER在329倍更低的摊销计算成本下,优于特定任务的文本序列化对比方法。PORTER是迈向无词汇依赖的EHR基础模型的重要一步,可减少词汇标准化需求,同时保持域内性能并支持高效跨任务复用。

原文摘要 · Abstract (English)

Most electronic health record (EHR) foundation models encode clinical events as discrete event tokens from a fixed vocabulary and therefore cannot directly represent events containing unseen concepts or new combinations of concepts and attributes such as numeric values. This limits transfer across institutions and even across deployment pipelines within the same institution. We introduce PORTER, a language-grounded structured EHR foundation model that decouples event representation from this fixed vocabulary. PORTER represents events through their descriptions using a frozen text encoder, integrates numeric values through a dedicated pathway, and learns clinical dynamics over patient timelines with an autoregressively pretrained temporal backbone. Across 74 clinical prediction tasks at a pediatric hospital, PORTER matched the mean AUROC of a fixed-vocabulary model with the same temporal backbone and pretraining objective. When the same patient timelines were rendered using event descriptions not seen during pretraining, PORTER transferred without retraining or vocabulary mapping, recovering 97.1% of the mean AUROC of a model trained directly on the target vocabulary. When transferred to MIMIC, PORTER outperformed the fixed-vocabulary model, which dropped 69% of events because their tokens were unseen. Mechanistic analyses showed cross-vocabulary transfer tracked preservation of patient-level representation geometry rather than the scale of the text encoder, and the numeric pathway improved sensitivity to magnitude without disrupting clinical concept identity. PORTER also achieved higher AUROC than a task-specific text serialization comparator, at 329-fold lower amortized compute. PORTER is a step toward vocabulary-independent EHR foundation models that reduce the need for vocabulary harmonization while preserving in-domain performance and enabling efficient cross-task reuse.

电子病历语言模型跨机构迁移结构化表示

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。