自监督Transformer提升MRI图像特征学习能力
SSPFormer: Self-Supervised Pretrained Transformer for MRI Images
- 通过频域掩码重建高频率解剖结构,实现结构感知表征
- 在分割、超分辨和去噪任务中均达当前最优性能
- 适合医学影像分析与临床应用研究者参考
预训练变换器在自然图像处理中表现出卓越的泛化能力,但直接应用于磁共振成像(MRI)面临两大挑战:难以适应医学解剖结构的特殊性,以及医疗数据隐私和稀缺性带来的限制。为此,本文提出自监督预训练变换器SSPFormer,通过利用未标注的原始影像数据,有效学习医学图像的领域特异性特征表示。为缓解领域差异与数据稀缺问题,引入逆频率投影掩码机制,优先重建高频解剖区域,强化结构感知表征学习;同时,在傅里叶域中采用频率加权的FFT噪声增强,注入生理上合理的噪声以提升对真实MRI伪影的鲁棒性。上述策略使模型能直接从原始扫描中学习领域不变且抗伪影的特征。在分割、超分辨率和去噪任务上的大量实验表明,SSPFormer达到当前最优表现,充分验证了其捕捉精细MRI图像保真度并适配临床应用需求的能力。
原文摘要 · Abstract (English)
The pre-trained transformer demonstrates remarkable generalization ability in natural image processing. However, directly transferring it to magnetic resonance images faces two key challenges: the inability to adapt to the specificity of medical anatomical structures and the limitations brought about by the privacy and scarcity of medical data. To address these issues, this paper proposes a Self-Supervised Pretrained Transformer (SSPFormer) for MRI images, which effectively learns domain-specific feature representations of medical images by leveraging unlabeled raw imaging data. To tackle the domain gap and data scarcity, we introduce inverse frequency projection masking, which prioritizes the reconstruction of high-frequency anatomical regions to enforce structure-aware representation learning. Simultaneously, to enhance robustness against real-world MRI artifacts, we employ frequency-weighted FFT noise enhancement that injects physiologically realistic noise into the Fourier domain. Together, these strategies enable the model to learn domain-invariant and artifact-robust features directly from raw scans. Through extensive experiments on segmentation, super-resolution, and denoising tasks, the proposed SSPFormer achieves state-of-the-art performance, fully verifying its ability to capture fine-grained MRI image fidelity and adapt to clinical application requirements.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。