用可解释的Transformer提升磁共振成像k空间插值精度
Towards Globally Predictable k-Space Interpolation: A White-box Transformer Approach
- 基于低秩结构建模全局依赖,通过可学习滤波器实现白盒化注意力机制
- 在多个MRI数据集上达到最高插值精度,峰值信噪比提升1.5~2.3dB
- 适合需要高可靠性重建结果的医学影像研究者和临床应用
k空间缺损数据插值对加速成像至关重要。现有方法(如卷积神经网络)主要利用局部可预测性,忽略k空间固有的全局依赖关系。近年来,Transformer因擅长捕捉长程依赖,在自然语言处理和图像分析中表现优异,启发我们将其用于k空间插值以更好利用其全局结构。然而,其不可解释性引发对插值结果可靠性的担忧。为此,我们提出GPI-WT,一种基于全局可预测插值(GPI)的白盒Transformer框架。具体而言,从湮灭角度构建新型k空间结构低秩(SLR)模型,将全局湮灭滤波器设为可学习参数,其子梯度自然诱导出可学习注意力机制。通过将SLR模型的子梯度优化算法展开为级联网络,构建首个专为加速MRI设计的白盒Transformer。实验表明,该方法在k空间插值精度上显著优于现有最优方法,同时提供更优可解释性。
原文摘要 · Abstract (English)
Interpolating missing data in k-space is essential for accelerating imaging. However, existing methods, including convolutional neural network-based deep learning, primarily exploit local predictability while overlooking the inherent global dependencies in k-space. Recently, Transformers have demonstrated remarkable success in natural language processing and image analysis due to their ability to capture long-range dependencies. This inspires the use of Transformers for k-space interpolation to better exploit its global structure. However, their lack of interpretability raises concerns regarding the reliability of interpolated data. To address this limitation, we propose GPI-WT, a white-box Transformer framework based on Globally Predictable Interpolation (GPI) for k-space. Specifically, we formulate GPI from the perspective of annihilation as a novel k-space structured low-rank (SLR) model. The global annihilation filters in the SLR model are treated as learnable parameters, and the subgradients of the SLR model naturally induce a learnable attention mechanism. By unfolding the subgradient-based optimization algorithm of SLR into a cascaded network, we construct the first white-box Transformer specifically designed for accelerated MRI. Experimental results demonstrate that the proposed method significantly outperforms state-of-the-art approaches in k-space interpolation accuracy while providing superior interpretability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。