arXiv:2508.05783cs.CVcs.AI2025-08被引 3

用少量标注数据部署预训练MRI Transformer,提升脑成像任务性能。

Few-Shot Deployment of Pretrained MRI Transformers in Brain Imaging Tasks

  • 基于大规模MRI数据预训练MAE,获得可迁移的特征表示。
  • 分类任务达顶尖准确率,分割任务在少样本下优于主流模型。
  • 适合资源有限的临床环境,支持多类脑成像任务部署。

基于变换器的机器学习在医学影像中潜力巨大,但受限于标注数据稀缺,实际应用困难。本研究提出一种面向少样本场景的预训练MRI变换器部署框架。通过在包含超过3100万张切片的多队列脑MRI数据集上采用掩码自编码器(MAE)预训练策略,获得了高度可迁移的潜在表征,可在不同任务和数据集间良好泛化。对于高层任务如分类,冻结的MAE编码器搭配轻量线性头,在极少监督下实现当前最优的MRI序列识别准确率。对于低层任务如分割,提出MAE-FUnet混合架构,融合多尺度CNN特征与预训练的MAE嵌入,在数据受限条件下持续优于多个强基线模型,涵盖颅骨剥离与多类别解剖分割。通过大量定量与定性评估,该框架展现出高效、稳定与可扩展性,表明其适用于低资源临床环境及更广泛的神经影像应用。

原文摘要 · Abstract (English)

Machine learning using transformers has shown great potential in medical imaging, but its real-world applicability remains limited due to the scarcity of annotated data. In this study, we propose a practical framework for the few-shot deployment of pretrained MRI transformers in diverse brain imaging tasks. By utilizing the Masked Autoencoder (MAE) pretraining strategy on a large-scale, multi-cohort brain MRI dataset comprising over 31 million slices, we obtain highly transferable latent representations that generalize well across tasks and datasets. For high-level tasks such as classification, a frozen MAE encoder combined with a lightweight linear head achieves state-of-the-art accuracy in MRI sequence identification with minimal supervision. For low-level tasks such as segmentation, we propose MAE-FUnet, a hybrid architecture that fuses multiscale CNN features with pretrained MAE embeddings. This model consistently outperforms other strong baselines in both skull stripping and multi-class anatomical segmentation under data-limited conditions. With extensive quantitative and qualitative evaluations, our framework demonstrates efficiency, stability, and scalability, suggesting its suitability for low-resource clinical environments and broader neuroimaging applications.

MRI少样本学习预训练分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。