用多模态数据提前12小时预测重症患者胸片异常,助力早期干预。
CXR-TFT: Multi-Modal Temporal Fusion Transformer for Predicting Chest X-ray Trajectories
- 融合胸片、报告与高频临床数据,通过时序对齐建模预测
- 在2万例患者中实现12小时前准确预警异常胸片变化
- 适合关注危重症早期预警与临床决策支持的研究者
重症监护病房中,复杂病情患者需密切监测与及时干预。胸片(CXR)是关键诊断工具,但其采集不规律限制了应用。现有方法多为截面分析,无法捕捉动态变化。为此,我们提出CXRTFT,一种多模态框架,整合稀疏胸片影像、放射科报告与高频率临床数据(如生命体征、化验值、呼吸记录),预测危重患者胸片变化轨迹。该模型利用视觉编码器生成的潜在嵌入,通过插值与每小时临床数据对齐,并采用变压器模型预测各时刻的胸片嵌入,基于历史嵌入与临床测量值。在20,000例患者的回顾性研究中,CXRTFT可提前12小时准确预测胸片异常,显著提升急性呼吸窘迫综合征等时间敏感疾病的早期干预可能。该方法提供具有时间分辨率的预后分析,为改善临床结局提供可操作的‘全患者’洞察。
原文摘要 · Abstract (English)
In intensive care units (ICUs), patients with complex clinical conditions require vigilant monitoring and prompt interventions. Chest X-rays (CXRs) are a vital diagnostic tool, providing insights into clinical trajectories, but their irregular acquisition limits their utility. Existing tools for CXR interpretation are constrained by cross-sectional analysis, failing to capture temporal dynamics. To address this, we introduce CXR-TFT, a novel multi-modal framework that integrates temporally sparse CXR imaging and radiology reports with high-frequency clinical data, such as vital signs, laboratory values, and respiratory flow sheets, to predict the trajectory of CXR findings in critically ill patients. CXR-TFT leverages latent embeddings from a vision encoder that are temporally aligned with hourly clinical data through interpolation. A transformer model is then trained to predict CXR embeddings at each hour, conditioned on previous embeddings and clinical measurements. In a retrospective study of 20,000 ICU patients, CXR-TFT demonstrated high accuracy in forecasting abnormal CXR findings up to 12 hours before they became radiographically evident. This predictive capability in clinical data holds significant potential for enhancing the management of time-sensitive conditions like acute respiratory distress syndrome, where early intervention is crucial and diagnoses are often delayed. By providing distinctive temporal resolution in prognostic CXR analysis, CXR-TFT offers actionable 'whole patient' insights that can directly improve clinical outcomes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。