PRISM模型通过大规模多序列MRI预训练,提升跨协议影像分析的通用性。
Large-scale Multi-sequence Pretraining for Generalizable MRI Analysis in Versatile Clinical Applications
- 构建首个大规模多器官多序列MRI预训练数据集,含33.6万例扫描
- 新预训练范式分离解剖共性与序列差异,保留高层语义信息
- 44项下游任务中39项排名第一,适合临床影像AI落地应用
多序列磁共振成像(MRI)具备优异的组织分辨能力,但不同序列间的固有异质性严重制约深度学习模型的泛化性能,尤其在不同采集参数下表现下降。本文提出PRISM——一个基于大规模多序列MRI预训练的基底模型。我们整合了64个公开与私有数据集,涵盖全身多器官结构,其中34个数据集(8个公开、26个私有)共336,476例体积化MRI扫描,构建了当前最大的多器官多序列MRI预训练语料库。提出一种新型预训练范式,将解剖学不变特征与序列特异性变化解耦,同时保留高层语义表示。建立包含44项下游任务的基准,涵盖疾病诊断、图像分割、配准、进展预测和报告生成,评估于32个公开数据集与5个私有队列。PRISM在所有任务中持续优于非预训练模型及现有基底模型,在44项基准中39项达第一,统计显著提升。结果表明其能学习跨未见数据、多样采集协议下的鲁棒通用表征。PRISM为多序列MRI分析提供可扩展框架,增强人工智能在放射学中的转化潜力,展现跨多种成像协议的一致性能,强化临床适用性。
原文摘要 · Abstract (English)
Multi-sequence Magnetic Resonance Imaging (MRI) offers remarkable versatility, enabling the distinct visualization of different tissue types. Nevertheless, the inherent heterogeneity among MRI sequences poses significant challenges to the generalization capability of deep learning models. These challenges undermine model performance when faced with varying acquisition parameters, thereby severely restricting their clinical utility. In this study, we present PRISM, a foundation model PRe-trained with large-scale multI-Sequence MRI. We collected a total of 64 datasets from both public and private sources, encompassing a wide range of whole-body anatomical structures, with scans spanning diverse MRI sequences. Among them, 336,476 volumetric MRI scans from 34 datasets (8 public and 26 private) were curated to construct the largest multi-organ multi-sequence MRI pretraining corpus to date. We propose a novel pretraining paradigm that disentangles anatomically invariant features from sequence-specific variations in MRI, while preserving high-level semantic representations. We established a benchmark comprising 44 downstream tasks, including disease diagnosis, image segmentation, registration, progression prediction, and report generation. These tasks were evaluated on 32 public datasets and 5 private cohorts. PRISM consistently outperformed both non-pretrained models and existing foundation models, achieving first-rank results in 39 out of 44 downstream benchmarks with statistical significance improvements. These results underscore its ability to learn robust and generalizable representations across unseen data acquired under diverse MRI protocols. PRISM provides a scalable framework for multi-sequence MRI analysis, thereby enhancing the translational potential of AI in radiology. It delivers consistent performance across diverse imaging protocols, reinforcing its clinical applicability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。