arXiv:2412.07387eess.IVcs.AI2024-12

通过跨序列掩码自监督学习,提升MRI图像表征能力

Enhanced MRI Representation via Cross-series Masking

  • 随机掩码多序列MRI中的区域,利用未掩码部分重建掩码内容
  • 在脑组织分割、乳腺肿瘤分类等任务上达到顶尖性能
  • 适合缺乏标注数据的医学影像分析场景

磁共振成像(MRI)能生成多序列图像,揭示不同组织特性,在疾病诊断和治疗规划中至关重要。然而,如何整合这些序列以形成连贯分析面临挑战,如空间分辨率差异、对比度模式不一,且需大量标注数据,而临床中此类数据稀缺。为此,我们提出一种新型跨序列掩码(Cross-Series Masking, CSM)策略,实现自监督的MRI表征学习。具体而言,CSM 随机采样部分区域与序列并进行掩码,在训练中利用未掩码数据重建被掩码部分,从而学习跨序列表示。该过程不仅融合多序列信息,还建模了序列内与序列间的相关性与互补性。基于学习到的表示,下游任务如分割与分类性能显著提升。在脑组织分割、乳腺肿瘤良恶性分类及前列腺癌诊断任务中,本方法在公开与内部数据集上均取得当前最优结果。

原文摘要 · Abstract (English)

Magnetic resonance imaging (MRI) is indispensable for diagnosing and planning treatment in various medical conditions due to its ability to produce multi-series images that reveal different tissue characteristics. However, integrating these diverse series to form a coherent analysis presents significant challenges, such as differing spatial resolutions and contrast patterns meanwhile requiring extensive annotated data, which is scarce in clinical practice. Due to these issues, we introduce a novel Cross-Series Masking (CSM) Strategy for effectively learning MRI representation in a self-supervised manner. Specifically, CSM commences by randomly sampling a subset of regions and series, which are then strategically masked. In the training process, the cross-series representation is learned by utilizing the unmasked data to reconstruct the masked portions. This process not only integrates information across different series but also facilitates the ability to model both intra-series and inter-series correlations and complementarities. With the learned representation, the downstream tasks like segmentation and classification are also enhanced. Taking brain tissue segmentation, breast tumor benign/malignant classification, and prostate cancer diagnosis as examples, our method achieves state-of-the-art performance on both public and in-house datasets.

MRI自监督学习医学影像跨序列

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。