联邦训练生成式模型,让多医院数据协作建模更有效且可迁移。
Federated generative event models for tokenized electronic health records

- 在12万+重症患者数据上,用联邦学习训练生成式事件模型。
- 跨院迁移性能损失仅0.025 ROC-AUC,远低于传统模型的0.079。
- 适合本地数据少的机构,尤其在多中心协作中提升建模能力。
电子健康记录基础模型受限于机构间数据孤岛,跨站点迁移时性能显著下降。本文评估了在三个独立医疗系统、共122,251例重症住院患者数据(统一为Common Longitudinal ICU Data Format)上,基于分词化生成式事件模型(GEMs)的联邦训练效果。模型在12项术后24小时临床预测任务上,分别测试了院内、跨院、集中式及联邦训练配置。GEMs在院内与跨院场景下均取得最高平均ROC-AUC值,其跨院性能损失(平均0.025 ROC-AUC,0.027 PR-AUC)远低于传统监督模型(分别为0.079和0.089)。联邦学习(FedAvg与FedAvgM)性能接近集中式训练,多数收益在5-10轮通信内实现。但集中式多站点训练仅小幅优于完全本地训练。当本地数据有限时,多站点模型优势明显,随机构数据积累而减弱。结果表明,联邦GEM训练技术可行且保留近似集中性能,但核心挑战在于学习可迁移表征,将异构多源数据转化为目标机构可用的可靠知识。
原文摘要 · Abstract (English)
Electronic health record foundation models are limited by institutionally siloed data and substantial performance degradation under cross-site transfer. We evaluated federated training of tokenized generative event models (GEMs) across 122,251 intensive care hospitalizations from three independent health systems harmonized to the Common Longitudinal ICU Data Format. Models were assessed on 12 post-24-hour clinical prediction tasks using within-site, cross-site, centralized, and federated training configurations. GEMs achieved the highest mean within-site and cross-site ROC-AUC and were substantially more transportable than conventional supervised models: their average cross-site penalties were 0.025 ROC-AUC and 0.027 PR-AUC, compared with 0.079 and 0.089 for LightGBM. Federated Learning (FedAvg and FedAvgM) approached the performance of centralized GEM training, with most gains obtained within 5-10 communication rounds. However, centralized multi-site training provided only modest improvements over complete local training. Multi-site models were most useful when local training data were limited, with their advantage narrowing as institutional data accumulated. These findings show that federated GEM training is technically feasible and preserves most centralized performance, but that the main open challenge is learning transportable representations to translate larger, but heterogeneous data from multiple health systems into a reliable target-site benefit.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。