用医保数据训练大模型,能精准预测疾病并提升医疗决策证据质量。
Foundation Models to Unlock Real-World Evidence from Nationwide Medical Claims

- 从438亿条医疗记录中训练生成式Transformer模型ReClaim,捕捉长期健康轨迹。
- 在1000多个疾病预测任务中平均AUC达75.6%,罕见病效果更显著。
- 适用于疾病监测、支出预测和真实世界证据生成,适合医疗研究与政策制定者。
基于大规模真实世界数据(RWD)的证据正日益影响监管评估与医疗决策。行政医保数据提供了覆盖人群、纵向追踪的医疗使用、支出及诊断、操作、用药的详细编码记录,但其作为医疗基础模型的潜力尚未被充分挖掘。本文提出ReClaim,一个从零训练的生成式Transformer模型,基于2008-2022年市场扫描(MarketScan)数据中超过2亿参保人、438亿医疗事件进行训练,参数规模达1.7亿至140亿不等。ReClaim建模了诊断、操作、用药与支出的长期轨迹,在超过1000个疾病发作预测任务中实现平均AUC 75.6%,显著优于特定疾病轻量级梯度提升机(LightGBM,66.3%)和基于Transformer的Delphi模型(69.4%),尤其在罕见病上优势明显。该性能在回顾性、前瞻性评估及两个独立外部数据集验证中均保持稳定。模型表现随规模单调提升,微调后比预训练提升13.8个百分点。除疾病预测外,ReClaim还有效捕捉财务结果:在支出预测中解释方差从0.28提升至0.37;在目标试验模拟中,系统偏差平均降低72%。结果表明,医保数据可作为可扩展的医疗基础模型底座,学习表征具备跨时间与数据源泛化能力,支持疾病监测、支出预测与真实世界证据生成。
原文摘要 · Abstract (English)
Evidence derived from large-scale real-world data (RWD) is increasingly informing regulatory evaluation and healthcare decision-making. Administrative claims provide population-scale, longitudinal records of healthcare utilization, expenditure, and detailed coding of diagnoses, procedures, and medications, yet their potential as a substrate for healthcare foundation models remains largely unexplored. Here we present ReClaim, a generative transformer trained from scratch on 43.8 billion medical events from more than 200 million enrollees in the MarketScan claims data spanning 2008-2022. ReClaim models longitudinal trajectories across diagnoses, procedures, medications, and expenditure, and was scaled to 140 million, 700 million, and 1.7 billion parameters. Across over 1,000 disease-onset prediction tasks, ReClaim achieved a mean AUC of 75.6%, substantially outperforming disease-specific LightGBM (66.3%) and the transformer-based Delphi model (69.4%), with the largest gains for rare diseases. These advantages held across retrospective and prospective evaluations and in external validation on two independent datasets. Performance improved monotonically with scale, and post-training added 13.8 percentage points over pre-training alone. Beyond disease prediction, ReClaim captured financial outcomes and improved real-world evidence (RWE) analyses: for healthcare expenditure forecasting it increased explained variance from 0.28 to 0.37 relative to LightGBM, and in a target trial emulation it reduced systematic bias by 72% on average relative to Delphi. Together, these results establish administrative claims as a scalable substrate for healthcare foundation models and show that learned representations generalize across time periods and data sources, supporting disease surveillance, expenditure forecasting, and RWE generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。