arXiv:2504.13037eess.IVcs.AI2025-04被引 17

整合心脏影像与患者信息,构建全面的心脏健康评估框架。

Towards Cardiac MRI Foundation Models: Comprehensive Visual-Tabular Representations for Whole-Heart Assessment and Beyond

  • 融合3D+T动态影像与患者表型数据,实现多模态统一建模。
  • 基于4.2万例英国生物样本库数据,支持疾病分类、分割与特征预测。
  • 面向临床研究与个性化风险评估,适用于心脏病学多任务场景。

心脏磁共振成像(CMR)是无创心脏评估的金标准,提供心脏解剖与生理的丰富时空信息。患者层面的健康因素(如人口统计、代谢和生活方式)显著影响心血管健康与疾病风险,但传统CMR无法捕捉这些信息。为全面理解心脏健康并准确评估个体疾病风险,需在统一框架中联合利用CMR与患者数据。现有跨模态方法多依赖有限时空数据且聚焦单一任务,难以形成综合表征。为此,我们提出ViTa,迈向心脏领域基础模型的重要一步,实现对全心结构与功能的完整表征及个体风险精准解读。基于42,000名英国生物样本库参与者数据,ViTa融合短轴与长轴视图的3D+T动态影像序列,完整捕捉心脏周期;再与详细表型数据融合,生成上下文感知的洞察。该多模态范式支持心脏表型与生理特征预测、分割、以及心血管与代谢疾病的分类等广泛下游任务。通过学习图像特征与患者背景之间的共享潜在表示,ViTa突破传统任务特定模型局限,推动向通用、个性化的临床心脏分析演进,展现其在临床应用中的潜力与可扩展性。

原文摘要 · Abstract (English)

Cardiac magnetic resonance imaging is the gold standard for non-invasive cardiac assessment, offering rich spatio-temporal views of the cardiac anatomy and physiology. Patient-level health factors, such as demographics, metabolic, and lifestyle, are known to substantially influence cardiovascular health and disease risk, yet remain uncaptured by CMR alone. To holistically understand cardiac health and to enable the best possible interpretation of an individual's disease risk, CMR and patient-level factors must be jointly exploited within an integrated framework. Recent multi-modal approaches have begun to bridge this gap, yet they often rely on limited spatio-temporal data and focus on isolated clinical tasks, thereby hindering the development of a comprehensive representation for cardiac health evaluation. To overcome these limitations, we introduce ViTa, a step toward foundation models that delivers a comprehensive representation of the heart and a precise interpretation of individual disease risk. Leveraging data from 42,000 UK Biobank participants, ViTa integrates 3D+T cine stacks from short-axis and long-axis views, enabling a complete capture of the cardiac cycle. These imaging data are then fused with detailed tabular patient-level factors, enabling context-aware insights. This multi-modal paradigm supports a wide spectrum of downstream tasks, including cardiac phenotype and physiological feature prediction, segmentation, and classification of cardiac and metabolic diseases within a single unified framework. By learning a shared latent representation that bridges rich imaging features and patient context, ViTa moves beyond traditional, task-specific models toward a universal, patient-specific understanding of cardiac health, highlighting its potential to advance clinical utility and scalability in cardiac analysis.

心脏MRI多模态学习基础模型表型预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。